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EXECUTIVE  SUMMARY 


INTRODUCTION 

The  Traffic  Aim  and  Ccdlisioa  Avoidance  System  n  (TCAS II)  is  becmning  widely 
deploy^  among  the  U.S.  Air  Carrier  fleet  The  growing  body  of  experience  gained  using 
TCAS  in  daily  (operations  has  uncovered  certain  tradmicies  in  which  its  Resolution 
Advis(nies  (PLAs)  are  often  judged  undesirable  and  potentially  distracting.  This  Operational 
experience  evolved  into  new  requirements  for  the  ICAS  logic  which  haw  been  addressed  by 
the  ptto>osed  versiim  6.04  (v6.04).  This  Study  assesses  the  safety  of  TCAS  in  domestic  U.S. 
airspace.  It  provides  specific  ctmiparisons  betweoi  the  previous  (version  6.0  [v6.0])  logic 
and  v6.04. 

The  primary  purpose  of  the  current  Safety  Stixly  is  to  enable  a  comparison  ctf  the  relative 
safety  of  the  two  versions  of  the  logic.  Tlie  facttx'  oi  greatest  concern  is  the  decreased 
warning  time  affotxied  by  TCAS  v6.04,  which  results  from  threshold  teducticms  designed  to 
eliminate  the  undesirable  advisories. 

This  study  makes  use  of  a  significant  quantity  of  data  collected  from  the  Automated  Radar 
Terminal  System  (ARTS)  in  characterizing  aircraft  encounter  geometries.  These  data 
represent  an  improvement  over  earlier  snides  with  respect  to  tite  validity  of  the  distribution 
of  aircraft  geometries  in  encounters.  The  study  also  employs  computer  mcxieling  and 
simulation  to  evaluate  the  effects  and  complexities  of  TCAS  logic  over  a  wide  variety  of 
situations.  While  TCAS  does  not  assure  separation  in  every  instance,  the  purpose  of  the 
selected  approach  is  to  account  for  many  possible  situations  in  their  appropriate  proportion. 

METHODOLOGY 

The  principal  innovative  method  underlying  much  of  this  analysis  is  the  mcxleling  and 
simulation  of  TCAS  logic  performance  for  close  encounters.  The  pertinent  characteristics  of 
enco’jnter  geometries  were  extracted  from  radar  data,  enabling  the  definition  of  a  set  of 
encounter  classes.  These  were  then  used  in  computer  simulation  to  test  large  numbers  of 
encounters  in  each  class. 

Figure  ES-1  summarizes  this  process  at  a  nigh  level. 

Data  Sources 

MITRE  has  generated  a  large  database  of  encounters  from  aircraft  tracks  recorded  at  a 
number  of  radar  sites  throughout  the  U.S.  Eight  sites  were  selected  for  this  study:  Burbank 
(BUR),  Coast  (CST)  (in  the  Los  Angeles  Basin),  Denver  (DEN),  Dallas-Fort  Worth  (DFW), 
New  York  (JFK),  Minneapolis-Saint  Paul  (MSP),  Seattle  (SEA),  and  Saint  Louis 
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Figure  ES'l.  Overview  of  Risk  Calculation 


(STL).  These  sites  were  chosen  to  represent  moderate  to  heavy  traffic  under  differing 
conditions  of  geography,  traffic  type,  and  Air  Traffic  Control  (ATC)  pnxredure. 

EncountM*  Statistics 

The  radar-derived  tracks  were  smoothed  and  resampled  at  the  1 -second  intervals  used  by 
TCAS.  Candidate  pairs  were  formed  and  run  through  the  TCAS  v6.0  lo^c  to  identify  those 
that  produced  RAs.  A  database  was  formed  that  collected  encounter  statistics  about  a  SO- 
second  window  containing  the  encounter's  point  of  closest  approach  (CPA).  The  encounters 
were  then  classified  according  to  the  combination  of  aircraft  profiles:  level,  climbing  or 
descending,  or  maneuvering  to  or  from  level  flight 

The  number  of  encounters  in  each  class  were  counted  by  site.  Also  collected  by  site  were  the 
statistics  of  vertical  separation,  or  Vertical  Miss  Distance  (VMD)  at  the  encounter  CPA. 
Other  statistics  were  collected  for  the  entire  set  of  sites,  such  as  the  distribution  of  vertical 
rates  and  accelerations  for  the  various  classes. 

The  encounter  classes  and  distributions  form  the  basis  of  a  theoretical  model  for  aircraft 
encounters  that  is  based  on  real  data.  The  modeling  enables  the  assessment  of  a  safety 
measure  and  is  particularly  useful  for  comparing  the  relative  performance  of  logic  versions. 

Altimetry  Error  Model 

Irrors  in  aircraft  altimetry  were  modeled  using  the  same  statistical  distributions  and 
variations  over  absolute  altitude  as  in  the  previous  Safety  Studies.  However,  this  study  is 
more  comprehensive  in  examining  the  effect  of  this  error  in  combination  with  TCAS  logic 
performance. 
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TCAS  EncoiuitM*  Siimiiatiom 


The  eimMinter  simulates  perforins  repeated  simuladons  of  specified  encount^  getnnetiies 
with  numerous  parametess  being  varied  on  successive  runs.  Every  sample  encounter  is  run 
three  times:  without  TCAS,  and  widi  each  aircraft  in  turn  carrying  and  responding  to  its 
TCAS.  while  the  other  is  non>TCAS.  The  same  encounters  are  rerun  fm*  both  the  v6.0  and 
v6.04  logic.  The  simulated  TCAS  aircraft  responds  to  any  TCAS  RAs  generated  according 
to  a  model  which  also  provides  a  range  of  stadsdcai  variadtMi.  Separations  are  compared 
both  with  and  without  TCAS  to  enable  the  tabuladcm  of  encounter  separation  statistics. 

Encounter  simulatimis  arc  run  for  one  Qass  (i.e.,  geometry)  at  a  time.  Each  set  of  runs 
duplicates  a  Class's  gemnetry  for  ten  "bands'*  of  nominal  vertical  separation  (VMD)  without 
TCAS.  To  saturate  each  band.  500  encounters  are  run  in  each,  with  the  vertical  separation 
randomly  drawn  from  a  uniform  distribution,  llie  first  band  uses  vertical  separations  at  CPA 
from  0  to  100  ft;  the  second  band  from  100  to  200  ft;  up  to  the  tenth  band  from  900  to 
1000  ft  This  study  is  specifically  intended  to  measure  the  Risk  Ratio.  Therefore,  only 
encounters  with  horizontal  miss  distance  (HMD)  less  than  500  ft  are  relevant  The  model 
forms  geometries  with  HMD  varying  over  0  to  500  ft  at  the  CPA.  These  encounter  Class 
simulations  are  repeated  for  each  of  the  six  altitude  layers  for  which  TCAS  uses  different 
logic  parameters. 

The  output  of  the  simulation  represents  a  distribution  of  the  perceived  vertical  separation  for 
the  encounters.  However,  the  aircraft  true  altitudes  may  differ  from  their  reported  altitudes. 
The  altimetry  error  model  is  used  to  calculate  the  probability,  averaged  over  these 
encounten,  that  the  true  separation  is  less  than  100  ft 

Combining  Results  for  Risk  Ratio 

The  results  of  the  various  simulation  runs  for  the  various  geometries,  vertical  separations,  and 
altitude  layers  are  combined  to  develop  an  overall  ratio  of  the  Near  Midair  Collision 
(NMAC)  risk  with  either  version  of  TCAS  compared  to  non-TCAS. 

•  The  results  for  low-quality  and  high-quality  altimetry  are  combined  according  to  the 
proportion  of  general  aviation  (GA)  aircraft  (60  percent)  found  in  the  database. 

•  For  each  encounter  geometry  ("Class"),  at  each  of  the  eight  sites,  the  simulation  runs 
are  collected  for  small  bands  of  vertical  separation,  without  TCAS.  The  simulation 
results  are  combined  using  the  frequencies,  from  the  encounter  database,  that  these 
separations  occur  at  each  site. 

•  The  resulting  NMAC  probabilities  for  each  Qass  then  are  combined  in  the  proportion 
that  the  various  classes  were  observed  at  each  site. 


•  The  ntio  of  this  overall  NMAC  probaoility  is  taken  between  each  logic  versiiMi  and 
no-TCAS. 

Fault  Tree  Calculations 

The  result  found  above  is  a  component  of  TCAS  Risk  Ratio  that  is  conditioned  upon  several 
events:  that  the  threat  is  Mode  C  equipped  and  tracked,  and  that  the  TCAS  RA  is  followed 
regardless  of  its  ccnrectness.  The  Fault  Tree  is  used  to  evaluate  these  conditions  in  the 
ctnrect  context 

RESULTS 
Encounter  Classes 

Considerable  differences  are  seen  in  the  environments  through  the  distribution  of  encounter 
classes  represented  by  this  collection  of  sites.  Leveloff  encounters  are  more  frequently 
observed  at  Dallas  than  anywhere  else.  Level  encounters  predominate  in  New  York  and 
Miimeapolis-St  Paul.  Pairs  of  descending  aircraft  are  much  more  common  in  St  Louis  and 
Denver.  Altitude  crossings  are  moderately  frequent  at  Burbank,  where  more  GA  mix  with  air 
carriers  than  at  these  other  sites.  The  differences  of  this  environmental  mix  also  can  be  seen 
from  figure  ES-2,  which  compares  the  proportions  of  some  of  the  larger  classes. 

Simulation  Results 

The  basic  simulation  runs  performed  for  this  study  (exclusive  of  degraded  surveillance  or 
climb-  or  descend-inhibited  cases)  totaled  780,000  encounters  for  each  version  of  the  logic. 
These  runs  included  all  classes  with  up  to  one  maneuver,  which  represented  98  percent  (1849 
of  1889)  of  the  RAs  in  tlie  database. 

The  simulations  of  the  various  encounter  classes  at  each  altitude  layer  produced  vertical 
separations  that  were  substantially  equal  to  the  intended  separation.  This  separation, 
designated  by  the  value  of  the  logic  parameter  altitude  limit  (ALIM),  is  decreased  somewhat 
in  the  v6,04  logic. 

The  greatest  number  of  encounters  with  poor  separation  arc  found  in  the  lowest  altitude  layer, 
below  2350  ft.  Most  of  these  encounters  are  unresolved  NMACs,  rather  than  induced. 

Combined  Altimetry  and  Logic  Performance 

The  combined  effects  of  logic  performance  (through  perceived  separation)  and  altimetry 
errors  are  calculated  assuming  all  RAs  arc  followed.  The  calculation  is  done  for  each  of  the 
eight  sites  using  both  the  encounter  class  distributions  and  the  vertical  separation  frequencies 
within  each  class  as  observed  at  that  site.  In  addition,  an  average  figure  is  developed,  which 
is  based  on  averaging  the  class  weights  and  IVMDI  across  sites. 
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Figure  ES-2.  Proportional  Frequencies  of  Encounter  Types  by  Site 


This  component  of  Risk  Ratio  increases  for  v6.04  by  an  amount  that  is  of  the  same  order  as 
the  variation  of  the  Risk  Ratio  among  sites  for  the  present  v6.0  logic.  Risk  Ratios  are  a 
means  of  comparison  to  the  NMAC  risk  prior  to  TCAS;  the  incremental  values  discussed 
here  are  1.S  to  2  orders  of  magnitude  smaller  than  the  no-TCAS  risk. 

The  subsequent  Fault  Tree  calculations  make  use  of  this  component  of  Risk. 

Sensitivity  Studies 

Imperfect  Surveillance 

Several  encounter  geometries  were  rerun  with  the  probability  of  TCAS  surveillance 
delivering  a  Mode  C  report  set  to  0.9  and  0.8  respectively.  The  value  0.8  is  thought  to  be  a 
typical  "worst-case"  probability  of  receiving  reports  through  a  high  density  interference 
environment.  For  crossing  encounters,  performance  degrades  marginally  with  surveillance 
quality,  but  the  increment  of  v6.04  Risk  Ratio  (versus  v6.0)  does  not  change  by  much  (from 
about  one  percent  to  1.5  percent).  For  leveloff  encounters,  the  Risk  Ratio  component 
actually  improves  slighdy  with  this  marginally  degraded  surveillance. 
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Tbese  nssuhs  ditt  impei&ct  surveillance  quality  will  not  have  a  signifkant  effect  tm 

die  relative  pferitetmaMc  of  thne  logic  versitms. 

Restricted  Aiidililirir  C«|mM 

Sevenl  racounttr  geotiKffies  were  rerun  to  compare  the  performaiKe  of  the  logic  wlwn 

TCAS  is  in  a  dinib-iidtitiited  r^^e  or  is  descend-inhibited  due  to  its  proximity  with 
the  groimd.  Tlie  test^  showed  TCAS  performai»e  to  be  si^iificantly  degraded  in  certain 
geometries,  cbmiMred  to  its  rionnal  performance.  These  geomeoies  are  die  obvious  ca^: 
where  TCAS  should  climb  but  can  not;  or  should  descend  but  can  not  do  so.  The  situations 
in  which  diis  occurs  should  be  infiequent,  since  v^  few  aircraft  types  are  climb-inhilnted, 
and  only  in  rate  conditions;  and  the  descend-inhibit  ^iplies  for  only  a  very  narrow  band  of 
altitude. 

Fault  Tree  Calculations 

This  section  collects  die  various  elements  ccMitributing  to  NMACs  and  calculates  their  total 
probability  relative  to  die  NMAC  risk  without  TCAS.  The  process  draws  upon  the  original 
fault  tree  developed  for  the  TCAS  Safety  Study,  with  certain  changes  to  account  for  the  more 
sophisticated  analysis  of  logic  performance,  llie  original  fault  tree  separated  NMAC  events 
into  two  categories  termed  "Unresolved"  and  "Induced."  The  present  study  examines  TCAS 
logic  performance  in  a  more  comprehensive  maimer  and  recognizes  that  some  of  the  resulting 
NMACs  carmot  be  meaningfully  categorized  as  either  Unresolved  or  Induced.  Accordingly, 
this  study  drops  the  distinction  between  Unresolved  and  Induced  NMACs  for  cases  related  to 
altimetry  and  logic  performance. 

Table  ES-1  presents  the  results  of  the  probability  calculations  of  event  chains  for  the  Critical 
NMAC.  The  figures  within  the  boxed  areas  represent  these  NMAC  probabilities.  They  are 
totaled  in  the  Summary  section  below  to  produce  the  final  risk  figure  for  the  condition  of  all- 
RA's  followed. 


Table  ES-l.  Fault  Tree  Calculation  of  Risk  Ratio 


V6.0 

V6.04 

Uiuesolved  NMAC  related  to  non-logic  factors: 
threat's  lack  of  Mode  C  equipage  and  surveillance 
limitations 

.0918 

.0918 

NMAC  related  to  altimetry  and  logic  performance 

.0061 

.0173 

TOTAL 

.0979 

.1091 

These  results  show  that  logic-related  NMACs  are  small  compared  to  residual  risks  not  related 
to  the  logic.  Figure  ES-3  illustrates  the  relative  proportions.  The  change  to  v6.04  has  little 
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Figure  ES-3.  Risk  Ratio  Components 


impact  on  the  total  risk.  The  contribution  of  non-logic  related  factors  (Mode  C  equipage, 
si^eillance,  visual  acquisition)  dominates  the  altimetry  and  logic-related  factors. 

The  result  shown,  based  upon  the  site-average  figures,  for  the  increment  of  v6.04  over  v6.0  is 
«q)pioximately  one  percent  of  the  no-TCAS  risk.  This  result  is  fairly  consistent  fOT  all  the 
sites  studied:  the  hugest  site  increment  is  1.7  percent  Obviously,  even  a  small  degradation 
in  protection  would  not  be  worthwhile  were  it  not  more  than  compensated  by  the  benefits 
sought. 

The  lowest  altitude  layer  is  the  greatest  contributOT  to  risk.  The  model  may  be  pessimistic  for 
this  layer,  where  ATC  exercises  tight  control.  If  this  layer  is  excluded  from  the  calculation, 
the  risk  ratio  increment  for  v6.04  is  0.6  percent 

It  must  be  emphasized  that  these  calculations  are  based  on  the  condition  that  all  TCAS  RAs 
are  followed  except  those  for  which  the  pilot  can  recognize  that  to  follow  the  RA  would  be 
unsafe.  The  next  section  makes  important  observations  that  modify  these  results  for  more 
realistic  conditions  related  to  the  fr^uency  of  following  RAs. 
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ADVISORIES 


Till  d^RsRid  lAiove  i^Ues  to  oonditiDiii  where  TCAS  RAs  aiwi^  are 

fiiBdniii^  alaliii  Itolitva',  early  openuiofial 

eicfN^flce  ^  shown  the  need  for  a  bluer  match  with  nonnal  ATC 

ojpiniishs,  liii  liilaiMie  ^iMficant  foactkm  TCAS  RAs  are  not  followed. 

TCAS  provyis  a  successively  inoeasing 
level  of  efflctivehifo,  vi^fo  fonihor  NMACs  n^cdved,  a^  a  conesptmding  decrease  in  die 
remaining  rhft.  AfihlCfo^  dSb  Idpe  nd  afometry-relaied  NMACs  increase,  their  frequemry  is 


Figure  ES-S  cdaipares  foi  decrease  in  Ride  for  the  two  versions  of  logic  when  treating  the 
fractimi  of  RAs  followed  as  a  continuous  variable.  The  scafe  is  exaggerated  for  clarity  in 
illustrating  die  followihg  concept  At  any  ctmstant  value  of  RAs  followed,  v6.04  has  higher 
ride;  however,  at  diie  pio^  where  "X"  percent  of  RAs  are  followed  using  the  present  (v6.0) 
logfo,  there  is  a  coitiespenduig  pennt  h^led  "Y"  percent  where  the  v6.(M  logic  has  identical 
Risk.  Since  the  6.Q4  logic  is  intended  to  eliminate  a  large  fraction  of  the  nuisance  alerts,  it  is 
anticipated  that  TCAS  advisories  win  be  follov^  more  frequently  using  v6.04.  It  would 
require  only  a  small  increase  in  this  rate  to  achieve  a  lower  risk  in  practice  than  is  now  being 
achieved  using  v6.0. 

Figure  ES-6  shows  die  actual  plot  of  die  site  average  Risk  variation,  drawn  to  scale.  This 
figure  uses  as  its  endpoints  die  Risk  Ratio  result  dim  is  computed  for  the  condition  of  all 
aircraft  following  their  advisories.  The  two  curves  are  extremely  close  together,  reflecting 
die  dominance  of  non-logic  contributors  to  risk,  principally  non-transponder  and  non-Mode 
C  equipped  aircraft,  and  TCAS  Mode  C  surveillance  limitations.  For  these  curves,  even  a 
one  percent  increase  in  the  fraction  of  RAs  followed  would  decrease  the  overall  risk.  A  five 
percent  increase  in  the  percentage  of  RAs  followed  would  decrease  overall  risk  by  about  four 
percent. 

Coordinated  Encounters 

The  following  factors  were  considered  for  TCAS-TCAS  coordinated  encounters; 
Surveillance  Failure 

Morte  S  surveillance  is  extremely  reliable.  The  probability  is  of  the  order  lO*^  or  lower  that 
either  TCAS  would  fail  to  track  the  other,  or  would  lose  track  before  issuing  an  RA. 

Coordination  Link  Failure 

Approximately  10*13  TCAS-TCAS  RAs  would  be  expected  to  have  both  uncoordinated 
vertical  sense  and  inattequate  horizontal  separation.  This  is  smaller  by  many  orders  of 
magnitude  than  most  other  risks  considered  in  this  study. 
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Figure  ES-4.  NMAC  Risk  According  to  Fraction  of  RAs  Followed 


Figure  ES-5.  Risk  Comparison  With  Different  Compliance  for 
Alternate  Lo^c  Versions 
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Figure  ES*i.  Risk  Variation  According  to  Fraction  of  RAs 
Followed — Site  Average  Rbk 


Failure  to  Follow  TCAS  Advisory 

The  Federal  Aviation  Administraticm  (FA A)  Technical  Center  has  peifomied  extensive 
simulations  of  such  encounters  and  have  concluded  that  in  virtually  every  encounter 
geometry,  the  two  aircraft  could  have  avoided  an  NMAC  by  following  their  respective  TCAS 
advisories.  This  leads  to  the  conclusion  Aat  a  maneuver  contrary  to  the  direction  advised  by 
TCAS  is  likely  to  reduce  the  vertical  separation. 

This  failure  category  has  potentially  greater  significance  than  any  other  failure  studied  for  the 
TCAS-TCAS  encounters.  Unfortunately,  its  magnitude  is  difficult  to  measure  and  especially 
difficult  to  predict  There  is  no  evidence  that  the  change  of  logic  version  would  increase  risk 
oi  this  type.  To  the  contrary,  if  v6.04  promores  increased  pilot  confidence  in  TCAS,  as  is 
intended,  more  of  its  advisories  may  be  followed,  with  a  s^ety  benefit  that  is  more-than- 
intrportional. 
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Unsafe  RcMlutiOB  Advisoitai 


A  coocdinated  TCAS-TCAS  enooimtBr  sbotdd  always  produce  a  successful  resdution  if  the 
advisories  are  folhiwed.  llieFAATeduiicalOeBta’ has  conducted  exinisii^  simulation  of 
micooniers  to  seaich  f<Dr(edtfaeriQntiiie  or  extreme  condidons  wh^  could  Iving  about  an 
unsuccesriiil  restdotion.  Tlie  only  such  geometry  duu  was  r^mted  to  fail  invcdved  an 
aifcraftinitially  cUmbing  at  aiateof  5000  feet  per  minute  (fpm)  and  encountering  a  level 
aircraft  as  it  began  to  level  off  with  a  1/3  g  acceleratitm.  Qose  encounters  of  this  are 
extremely  infrequent  in  comparison  to  the  tounne  encounters  dun  contribute  to  die  Risk  Ratio 
comptment  for  unequij^ied  intruders.  Qxnparing  diese  simulation  results  with  those 
performed  at  The  MITOE  Corporation,  their  neariy  perfect  rate  of  successful  rteolution 
indicates  that  the  logic-related  component  of  Risk  Ratio  should  be  smaller  by  several  orders 
of  magnitude  than  the  performance  of  the  logic  in  encounters  with  unequipp^  ducats. 


CONCLUSIONS 

This  study  has  examined  over  10.000  aircraft  encounters  at  eight  sites  having  different 
environments  with  respect  to  encounter  geometries.  Encounter  modeling  was  conducted 
based  upon  1889  RA-producing  encounters.  780.000  Simulation  runs  using  the  complete 
logic  have  exercised  a  wide  variety  of  geometry  types  for  unequipped  threats. 

1.  For  the  condition  that  all  TCAS  RAs  are  followed  unless  recognized  as  unsafe,  logic 
v6.04  would  produce  a  Risk  Ratio  only  about  one  percent  greater  than  for  v6.0,  on  a 
theoretical  site-average  basis. 

2.  The  greatest  contribution  to  the  v6.04  increment  comes  from  the  altitude  layer  below 
2350  ft,  where  the  lowest  warning  time  is  used.  Since  the  ATC  system  is  highly 
structured  in  that  airspace,  using  the  overall  distributions  of  encounter  classes  and 
vertical  rates  may  be  unrealistic  and  give  pessimistic  results.  Excluding  the  lowest 
layer,  the  Risk  Ratio  increment  is  about  0.6  percent 

3.  The  variation  of  this  Risk  Ratio  increment  among  the  sites  studied  was  not  great 
despite  very  substantial  differences  in  the  encounter  geometry  proportions  that  were 
found.  The  greatest  change  in  Risk  Ratio  for  any  of  these  sites  was  1.7  percent  This 
gives  confidence  that  studying  other  locations  also  would  yield  results  very  similar  to 
the  average  figure.  Furthermore,  the  increment  due  to  the  new  logic  version  is  of  the 
same  order  as  the  normal  site-to-site  variations. 

4.  Recognizing  that  today  pilots  frequently  do  not  follow  RAs,  often  because  of  low 
confidence  in  TCAS,  the  achieved  level  of  safety  may  be  far  from  the  ideal.  If  v6.04 
raises  pilot  confidence  to  the  point  where  even  a  few  percent  more  RAs  are  followed, 
the  achieved  level  of  safety  would  improve,  mote  than  compensating  for  the  reduction 
in  warning  time  that  eliminates  many  unnecessary  RAs. 
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5.  Fof  eoQliibMMnl  eiiMunim,  Ac  k^pc,  siB^eUlftPce,  and  cocxyiination 

Tbegreatest 

This  may  be  alleviated  if 

v6^  bilnp  lik^  ioeimued 

6.  The  Kiilt  Ratio  compowant  doe  to  logic  is  ooly  slif^y  degraded  by  imperfisct 
wnmOMee  The  mladvepei'fiDfmaaoe  of  the  two  It^  versions  ai^eam 
OBchaaeBd. 

7.  Whm  TCAS  is  in  a  dimb^nhibited  fli^tt  legiiiie,  or  is  descmd-inhibited  due  to  its 
pKUuimqr  widt  the  grounds  its  petformaoce  is  significantly  restricted.  Such  situations 
shcMild  occur  very  iitfiequently  relative  to  the  rate  of  dose  encounters  addressed  in 
tlusstutfy. 


SECTION  1 


INTRODUCTION 


The  Traf^  Alert  and  Collision  Avoidaiice  System  n  (TCAS II)  is  beccnning  widely 
deployed  among  the  U.S.  Air  Carrier  fleet  in  aiKordance  with  Federal  Aviation 
Administration  (FAA)  regulations.  Smaller  numbers  of  General  Aviation  (GA)  and 
IntematitMial  users  alw  are  equipping  with  TCAS  0  (hereafter  termed  TCAS).  The  growing 
body  of  experience  gained  using  TCAS  in  daily  operatkms,  however,  has  uncovered  certain 
tendencies  in  which  its  Resolution  Adviscnies  (RAs)  are  often  judged  undesirable  and 
potentially  distracting.  This  qteradonal  expetieitee  evolved  into  new  requirements  for  the 
TCAS  logic  which  have  been  addressed  by  the  pn^x>sed  Version  6.04  (v6.04)  [1].  The  new 
logic  is  intended  to  better  match  TCAS  with  the  Ak  Traffic  Control  (ATC)  system. 

This  study  assesses  the  safety  of  TCAS  in  domestic  U.S.  airspace.  It  provides  specific 
comparisons  between  the  previous  (version  6.0  [v6.0])  logic  and  v6.04.  Together  with 
companion  studies  of  operational  characteristics  [2],  Ais  Safety  Study  will  give  insight  into 
the  effects  of  using  the  6.04  logic. 

The  1983  Safety  Study  of  TCAS  11  [31  defined  the  criterion  of  Risk  Ratio  as  the  metric  of 
risk.  That  study  also  deflned  the  criti^  Near  Midair  Collision  (NMAC)  as  the  root  event, 
and  created  a  Fault  Tree,  which  enumerated  combinations  of  credible  events  that  could  lead 
to  an  NMAC.  The  study  used  available  data  from  various  sources  to  evaluate  most  of  these 
branches.  Other  elements,  principally  addressing  factors  such  as  crew  actions,  were 
evaluated  parametrically. 

In  1988,  a  Safety  Study  Update  [4]  was  performed  to  evaluate  significant  changes  in  TCAS 
logic  and  to  incorporate  new  data  both  for  aircraft  altimetry  error  and  for  encounter 
separation.  The  logic  changes  included  new  methods  for  selecting  advisory  sense  in  potential 
vertical  crossing  situations;  for  selecting  advisory  strength  in  converging  situations  which 
often  developed  into  safely  separated  passages;  for  reversing  advisory  sense  during  an 
encounter,  or  for  advising  an  increased  escape  maiteuver  during  an  encounter.  This  study 
also  considered  the  effects  of  increased  transponder  equipage  among  the  airspace  population 
as  a  result  of  an  FAA  Proposed  Rule. 


1.1  PURPOSE  OF  STUDY 

The  primary  purpose  of  the  current  Safety  Study  is  to  enable  a  comparison  of  the  relative 
safety  of  TCAS  v6.04  logic  with  the  currently  used  v6.0.  Version  6.04  contains  some 
corrections  which  can  only  enhance  safety,  such  as  in  correctly  modeling  the  maneuvers 
considered  during  climb-inhibited  or  descend-inhibited  conditions.  However,  the  factor  of 
greater  concern  is  the  decreased  warning  time  afforded  by  TCAS  v6.04,  which  results  from 
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threshtdd  reductioiis  designed  to  eliminate  the  undesirable  adviscnies.  The  most  pertinent  of 
these  changes  can  be  sununarized  as  follows: 

•  Uang  lower  sensitivity  levels,  with  smaller  |»otection  volume,  in  certain  low  altitude 
regkms 

•  Decreasing  the  warning  time  parameter  ("TAU”) 

•  Decreasing  the  vertical  threshold  for  positive  adviscnies  (altitude  limit  "AUDM"). 
which  represents  the  nominal  vertical  separatitm  that  TCAS  attempts  to  achieve 

•  Furtlrer  decreasing  the  wanting  time  (TAU)  in  certain  encounter  geometries: 

—  Fa*  the  level  aircraft  against  a  vertically  converging  threat 

—  For  the  aircraft  with  tire  lower  vertical  rate  when  a  threat  is  converging  with  the 
same  vertical  sense 

The  purpose  of  these  changes  is  to  improve  the  match  between  TCAS  and  the  ATC  system. 
Some  of  the  observed  inomipatibilities  have  been  systematic,  such  as: 

•  Advisories  at  low  altitudes  causing  unnecessary  go-arounds 

•  Mixed  instrument  flight  rules  (IFR)- visual  flight  rules  (VFR)  traffic  causing 
excessive,  unnecessary  advisories 

•  Advisories  such  as  the  "bump-up"  disrupting  ATC  operations  at  higher  altitudes 

The  approach  to  the  changed  logic  is  to  selectively  reduce  thresholds,  as  described  above,  so 
that  the  greatest  improvement  in  compatibility  can  be  achieved  with  minimal  change  in  the 
protection  TCAS  affords. 

This  study  makes  use  of  a  significant  quantity  of  data  collected  from  the  Automated  Radar 
Terminal  System  (ARTS)  in  characterizing  aircraft  encounter  geometries.  These  data 
represent  an  improvement  over  earlier  studies  with  respect  to  the  validity  of  the  distribution 
of  aircraft  gernnetries  in  encounters.  The  study  also  employs  computer  modeling  and 
simulation  to  evaluate  the  effects  and  complexities  of  TCAS  logic  over  a  wide  variety  of 
situations.  While  TCAS  does  not  assure  separation  in  every  instance,  the  purpose  of  the 
selected  approach  is  to  account  for  many  possible  situations  in  their  appropriate  proportion. 

This  method  of  modeling  the  complete  logic  performance  allows  a  more  comprehensive 
examination  of  the  causes  and  extent  of  circumstances  for  which  the  logic,  in  combination 
with  altimetry  error,  fails  to  provide  adequate  vertical  separation. 
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U  ORGANIZATION  OF  DOCUMENT 


This  iqxxt  assumes  some  famUiari^  with  TCAS  and  widi  the  concepts  of  the  Fault  Tree  and 
Ride  R^fiom  the  previous  TCAS  Safety  Stttdim.  This  section  provides  an  overview. 
Section  2  describes  Medraddogy  used  in  the  study,  including  die  encountm- 
classificatioa,  the  modding  of  encounters,  die  simulation  ai  close  micountm,  and  the 
calculation  of  risk  firom  simulation  results.  Section  3  provides  the  results  of  diese  same 
activities.  Section  4  contains  special  analyses  ttf  feilure  to  follow  RAs,  and  (tf  encounters 
against  another  TCAS^uqqiedaircrBft.  Seetkm  S  contains  the  Conclusions  of  the  study. 
Appewtix  A  contains  an  andysis  of  altimetry  error  on  safety,  assuming  nominal  logic 
p^ormance.  AppoMlix  B  contains  additional  details  oi  the  simulation  testing  surmnaiized  in 
section  3.  Append  C  presents  statistics  summarizing  the  results  of  die  simulation  testing 
for  v6.04.  Appendix  D  derives  die  equations  governing  die  effects  of  two-aircraft  altimetry 
errors. 
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SECTION  2 


METHODOLOGY 


2,1  OVERVIEW 

This  section  describes  the  methods  used  to  evaluate  the  relative  performance  of  TCAS  logic 
versions  with  ieq)ect  to  NMAC  risk.  The  two  {ffincipal  concerns,  as  in  the  earlier  studies, 
remain  estimating  TCAS*  ability  to  lescdve  NMAC  ipometries,  and  estimating  die  piobability 
that  ftdlowing  a  TCAS  advisory  would  induce  an  NMAC  that  othmwise  would  not  have 
occurred. 

The  principal  innovative  method  underlying  much  of  this  analysis  is  the  modeling  ai^ 
simulation  of  TCAS  logic  performance  for  close  encounters.  The  pertinent  characterisdcs  of 
encounter  getmietries  were  extracted  from  radar  data,  enabling  the  definidcm  of  a  set  of 
encounter  classes.  These  are  then  used  in  ccmiputer  simuladon  to  test  large  numbers  of 
encounters  in  each  class.  With  this  method,  the  performance  of  TCAS  arid  its  safety 
implicadons  fox  close  encounten  can  be  predict^  with  much  greater  confidence  th^  by 
simply  observing  the  more  varied  encounters  that  routinely  occur.  Close  encounters  are 
reladvely  rare,  and  the  perfrvmance  of  TCAS  logic  in  other  encounters  is  not  idendcal  to  its 
performance  in  the  close  ones.  However,  the  larger  set  of  encounters  is  useful  for  creadng 
models  of  aircraft  verdcal  profiles. 

Since  the  study  is  projecting  TCAS  performance  fra*  close  encounters,  it  would  be  ideal  to 
collect  a  large  database  of  them.  However,  their  scarcity  requires  the  pooling  of  data  from 
encounters  with  greater  separadon.  However,  the  database  formed  using  v6.0  logic  has 
99  percent  of  its  encounters  that  are  only  within  2  naudcal  miles  (nmi).  The  approach  used 
pools  aircraft  profile  data  (rates,  acceleradons)  «30ss  all  aldhides  and  sites.  These  are  used 
to  create  models  for  simulating  encounters  with  TCAS  logic.  On  the  other  hand,  the  class 
distribudons  and  verdcal  separadon  distribudons,  which  qjpear  to  be  more  a  fiincdon  of 
ATC  procedures  and  traffic  mix,  are  examined  separately  by  site.  These  distribudons  are 
used  in  post-processing  the  simuladon  results,  making  it  more  feasible  to  examine  variadons. 

The  process  follows  several  steps,  which  are  described  in  the  indicated  secdons: 

•  Characterize  the  airspace  using  encounters  found  from  ARTS  data  (secdon  2.3) 

•  Define  models  for  simuladng  close  encounters,  using  observed  distribudons  of 
parameters  (secdun  2.4) 

•  Simulate  close  encounters,  primarily  NMACs  or  those  for  which  TCAS  might  induce 
an  NMAC  (secdon  2.4) 
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•  Prom  the  distribution  of  perceived  separation,  analyze  the  effect  of  altimetry  errors 
and  cakulate  the  i»obability  of  NMAC  (section  2.5) 

•  Combine  simulation  results  in  proportions  corresponding  to  observed  encounter 
distributions  (section  2.5) 

•  Apply  fault  tree  factors  and  combine  with  non-logic  limitations  in  resolving  NMACs 
(section  2.6) 

Figure  I  summarizes  this  process  at  a  high  level. 


Smooth  a  Rosampio  ARTS  Tracks 
Saloct  Potantial  Pairs 
Noftnalizs  Enoountar  Window 
Form  Oatabasa 
Classify  by  Gaomatry 
Idantify  Paramatar  Distributions 


•  Sknulats  Encountar  Gaometrias 

•  Pariorm  Rapaatad  Trials; 

-  Altituda 

-  Vartical  Separation 

•  Collact  Separation  Statistics 


•  Calculate  Altimatiy  Error 

•  Aggregate  Over  Vertical  Sap. 

•  Aggregate  Altituda  Layers 

•  Aggregate  Encountar  Classes 

•  Calculate  Risk  Ratio 

-  Average 

-  By  Site 


Figure  1.  Overview  of  Risk  Calculation 


2  J  DATA  SOURCES 

In  order  to  obtain  a  realistic  model  of  the  performance  of  TCAS,  it  is  desirable  to  observe  the 
behavior  of  aircraft  and  compile  a  database  of  pairwise  encounters  from  tlie  airspace  of 
interest.  Prior  to  this  study,  there  existed  only  a  relatively  restricted  database  of  European 
encounters.  As  part  of  the  current  cffon.  The  MITRE  Corporation  has  generated  a  large 
database  of  encounters  from  aircraft  tracks  recorded  at  a  number  of  radar  sites  throughout  the 
U.S.  A  brief  description  of  this  database  is  given  here.  Deuils  are  being  published 
separately  [5]. 

ARTS  sites  used  in  this  study  are  at  major  airports  and  they  cover  the  surrounding  airspace 
out  to  a  distance  of  approximately  45  nmi.  The  scan  rate  is  typically  12  to  13  rpm.  Using  a 
secondary  radar,  the  ARTS  system  also  records  the  altitude  (Mode-C)  transmissions  of  those 
aircraft  with  Mode-C  transponders.  These  altitudes  are  rounded  off  to  the  nearest  100  feet  by 
the  aircraft  prior  to  transmission  and  they  are  scanned  synchronously  with  the  range/azimuth 
reports  sensed  by  the  primary  radar.  The  result  is  a  sequence  of  X,  Y,  Z.  and  T  for  nearly 
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eveiy  aircraft  in  the  vunnity  die  airpmt  with  updates  every  four  to  fiwi  seconds.  Fnm 
these  raw  data,  odwr  quandtus  of  interest  (e.g.,  speeds,  acoeleratums,  etc.)  may  be  derived. 

Eif^t  sites  were  sefascted  for  this  study:  Btnrbank  (BUR),  Coast  (CST)  (in  die  Los  Angeles 
Basin),  Denver  (DEN)^  Dallas>FQrt  Worth  (DFW),  New  York  (JI^,  Minnetqxdis-Saint  Paul 
(MSP).  Seatde  (SEA)  and  Saint  Louis  (SUL).*  These  sitM  were  diosen  to  represent 
moderate  to  heavy  tr^c  under  diffoing  conditions  of  geography,  traffic  type,  aiul  ATC 
isocedure. 

ARTS  data  do  not  have  the  1-Hertz  update  rate  of  TCAS  tracks.  Therefore,  all  of  our 
recmded  tracks  were  subjected  to  a  spline-fitting  i»ocedute  and  resampled  at  1  Hz.  The 
resulting  data  are  somewhat  cleaner  than  are  die  target  reports  seen  by  TCAS.  In  discussing 
the  simulatitHi  (section  3.4),  this  study  addresses  the  effects  of  degraded  surveillance. 

The  resampled  tracks  were  considered  pairwise  using  a  coarse  filtering  procedure  which 
follows  the  basic  form  of  TCAS  detection  logic.  This  process  forms  candidate  pairs  for 
TCAS  encounters;  it  selects  six  to  eight  times  as  many  candidates  as  actually  give  RAs  using 
v6.0  logic,  and,  therefore,  should  not  miss  any  pairs  (unless  a  track  was  missing  or  very 
short).  Pairs  for  which  both  aircraft  were  iden^ed  as  GA  were  excluded  at  this  point,  since 
these  aircraft  are  unlikely  to  equip  with  TCAS  II. 


2J  MODELING 

The  analysis  outlined  in  section  2.1  for  those  aspects  of  TCAS  safety  addressed  by  this  study 
requires  a  general  scheme  for  describing  encounters  plus  models  for  four  quantities:  IVMDI 
weights  (Wv),  layer  weights  (wi),  class  weights  (wc),  and  altimetry  error.  &u:h  of  these  is 
described  below. 

2.3.1  Classifying  Encounters 

The  performance  of  TCAS  depends,  in  part,  on  the  geometry  of  the  encounter  and  the 
maneuvering  of  aircraft  during  the  encounter.  These  factors  have  been  combined  into  the 
concept  of  "encounter  class". 

Since  the  performance  is  being  compared  of  two  versions  of  TCAS  to  each  other  as  well  as  to 
"No  TCAS",  it  is  essential  to  have  firm,  unambiguous  definitions  for  "encounter"  and 
"encounter  class".  We  begin  by  normalizing  the  time  dimension  with  a  standard  encounter 
"window".  This  window  is  presented  schematically  in  figure  2. 


1  Additional  sites  from  the  Los  Angeles  Basin  were  not  used  here,  to  avoid  any  risk  of 
biasing  the  database  towards  one  region. 
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t-C7A-40 


1  } 

t  =  CPA  t  =  CPA+IO 


Figure  2.  Encount^  Window 


The  encounter  window  has  its  origin  at  the  time  of  closest  point  of  approach  (CPA).  From 
this  point,  it  extends  backwards  40  seconds  and  forward  10  seconds.  This  window  contains 
the  interval  that  affects  die  selection  and  execution  of  maneuvers  to  resolve  the  encounter.  It 
also  is  unlikely  that  more  dian  two  vertical  profile  segments  would  be  flown  in  this  short  a 
window.  The  database  includes  only  encounters  for  which  both  aircraft  were  present 
throughout  the  entire  window.  In  the  descriptions  which  follow,  the  three  times  shown  above 
(from  left  to  right)  are  referred  to  as  points  A,  B,  and  C.  Whichever  aircraft  was  the  more 
"level"  at  point  A  is  designated  as  Aircraft  #1. 

To  determine  a  reasonable  threshold  for  "level",  a  large  number  of  plots  of  recorded 
encounters  were  examined.  It  was  found  that  vertical  speeds  less  than  400  fpm  could  not  be 
reliably  discerned  given  the  quantization  noise.  Therefore,  aircraft  having  IZDotl  <  400  fpm 
are  defined  to  be  "level";  the  rest  are  "transitioning".  These  definitions  permit  the 
classification  of  all  pairwise  encounters  according  to  (a)  the  level/transitioning  status  of  each 
aircraft  before  and  after  CPA  and  (b)  the  presence  of  an  altitude  crossing.  Since  "level"  is 
defined  to  include  any  vertical  speed  less  than  400  fpm,  it  is  possible  that  there  could  be  a 
crossing  even  when  toth  aircraft  are  said  to  be  level.  The  20  encounter  classes  consistent 
with  these  definitions  are  listed  in  table  1. 

In  classes  zero  and  ten,  both  aircraft  are  level  before  and  after  CPA.  Given  our  procedure,  we 
have  no  mechanism  to  force  a  crossing  (or  avoid  a  crossing)  in  these  circumstances. 
Consequently,  these  two  classes  were  combined.  They  will  be  referred  to  subsequently  as 
class  10+0. 

23  J  iVMDf  Weights 

TCAS  logic  operates  in  a  symmetrical  manner  for  TCAS  above  or  below  the  threat.  A  more 
pertinent  factor  is  the  presence  or  absence  of  an  altitude  crossing  during  the  encounter,  this  is 
covered  by  the  definition  of  classes.  Within  a  class,  the  absolute  value  of  vertical  separation 
at  CPA,  IVMDI,  is  used  as  the  primary  controlling  variable.  The  simulation  runs,  described 
in  section  2.4,  cover  geometries  with  vertical  separations  ranging  from  zero  to  1000  feet. 

This  range  is  partitioned  into  ten  equal  bands.  The  results  are  combined  as  described  in 
section  2.5,  using  the  observed  frequencies  exhibited  by  the  tracks  for  RA-producing 
encounters  in  the  database.  They  vary  from  site  to  site  and  from  class  to  class.  For  each  site, 
this  gives  a  vector  of  ten  values  for  w,  for  each  of  the  19  classes.  In  addition,  an  unweighted 
average  of  these  vectors,  across  sites,  is  used  to  compute  a  site  in dependent  result 
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Table  L  Encounter  Qasses 


Class 

Aircraft#! 

Before  CPA  After  CPA 

Aircnift#2  | 

Before  CPA  After  CPA  I 

Croning 

0 

L 

L 

L 

L 

✓ 

1 

L 

L 

T 

T 

✓ 

2 

L 

L 

L 

T 

✓ 

3 

L 

L 

T 

L 

✓ 

4 

T 

T 

T 

T 

✓ 

5 

L 

T 

T 

T 

✓ 

6 

T 

T 

T 

L 

✓ 

7 

L 

T 

L 

T 

✓ 

S 

L 

T 

T 

L 

✓ 

9 

T 

L 

T 

L 

✓ 

10 

L 

L 

L 

L 

11 

L 

L 

T 

T 

12 

L 

L 

L 

T 

13 

L 

L 

T 

L 

14 

T 

T 

T 

T 

15 

L 

T 

T 

T 

16 

T 

T 

T 

L 

17 

L 

T 

L 

T 

18 

L 

T 

T 

L 

19 

T 

L 

T 

L 

Notes:  L  « l^vel;  T  =  Transitioning;  Crossing  refers  to  altitude  crossing.  In  classes  2  and 
12,  either  aircraft  may  be  transitioning  after  CPA.  In  classes  6  and  16,  either  aircraft 
may  be  level  after  CPA. 

Note  that  all  classes  are  disjoint.  This  means  that  the  total  probability  (of  anything) 
over  all  classes  is  the  sum  of  the  respective  probabilities  for  the  individual  classes. 


These  weights  characterize  the  environment  of  close  encounters  prior  to  any  action  of  TCAS. 
The  character  of  this  environment  (since  it  was  recorded  prior  to  widespread  TCAS 
equipage)  is  independent  of  TCAS  logic.  In  this  study,  the  RA-producing  encounters  of  v6.0 
form  the  database.  Version  6.04  issues  RAs  for  a  subset  of  these  encounters.  Therefore,  no 
close  encounters  critical  to  either  logic  should  be  missing  from  this  database. 

23J  Layer  Weights 

Aircraft  altitudes  are  addressed  over  six  "layers"  because  TC^AS  logic  parameters,  and 
consequently  its  performance,  arc  a  function  of  altitude.  The  six  layers  are  defined  in  table  2. 
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Table  2.  Altitude  Laycn 


tayer 

Lower  Bound  (ft) 

Upper  Bound  (ft) 

Weight  (wi) 

1 

SfXVIOOO 

2300 

0.14 

2 

2301 

5000 

0.27 

3 

5001 

10000 

0.33 

4 

10001 

20000 

0.21 

5 

20001 

30000 

0.04 

6 

30001 

35000 

0.01 

The  layer  weights,  wi,  reflect  historical  proportions  of  reported  NMACs.  They  are  taken 
from  the  same  databaw  used  in  the  altimetiy  analyses  oi  the  two  previous  Safety  Studies. 
They  are  held  constant  and  are  assumed,  for  purposes  of  this  study,  to  represent  the  altitude 
distribution  of  close  encounters  across  all  classes  and  sites. 

The  lower  limit  of  layer  1  diners  between  v6.0  and  v6.04.  In  this  study,  no  provision  is  made 
for  calculating  the  loss  of  protection  in  this  nairow  band  of  aldtucfe,  where  TCAS  by 
community  consensus  is  taken  out  of  its  RA  mode. 

2  J.4  Class  Weights 

Class  weights  were  determined  simply  by  counting  the  RAs  in  each  class  in  the  database  and 
dividing  by  the  total  number  of  RAs  (see  section  3.1).  These  weights  were  determined  site 
by  site.  In  addition,  as  an  "average"  number,  a  set  of  class  weights  averaged  over  all  sites 
were  calculated. 

2.33  Parameter  Distributions 

Various  parameters  were  extracted  from  the  encounter  database.  The  most  significant  for 
simulation  modeling  is  the  distribution  of  vertical  rates.  A  distribution  was  devel(^)ed  for 
each  profile  (climb/descend,  level,  leveling,  and  level-to-transitimi).  Relative  range  rates, 
vertical  accelerations,  and  horizontal  miss  distances  (HMDs)  were  also  extracted  for  the 
creation  of  encounter  models.  All  the  distributions  represent  a  pooling  over  all  the  sites  and 
altitudes. 

23.6  Altimetry  Error 

Aircraft  altitudes,  observed  by  either  a  ground  radar  or  a  TCAS  receiver,  are  subject  to  ertOTs 
caused  by  the  altimeter  system  itself  and  by  the  quantization  of  the  altimeter  output  (to  the 
nearest  1(X)  feet)  in  the  Mode-C  system.  Previous  TCAS  safety  studies  examined  the  sources 
of  altimetry  error  and  estimated  variances  for  the  altitude  error  of  a  single  aircraft  and,  hence, 
for  the  error  in  the  vertical  separation  of  two  aircraft  By  treating  altimetry  errcH'  as  a  random 
variable  and  assuming  a  form  for  the  density  function  for  the  separation  error  ("overlap 
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deasity'Ti  it  was  pCMiiMe  toMaaie  the  oootrib^  of  aMmetiy  error  to  NMAC  probability 
given  ^  tibe  NlkD  fw  len  thaa  500  feet  and  that  the  maneoven  inade  in  leipoiise  to 
TCASRAsproduoed  fee  nominal  Kpaiatiofi.  A  lecatenlatinn  of  this  earlier  mefeod  i« 
peifennediniq^imidla  A.  The  lesifei  of  feat  calculation  are  conristein  wife  feii  mefeod. 

hi  fee  present  «udy.  fee  effect  <tf  altiinetty  ener  ia  combined  more  ejqdicitly  wife  fee 
peifecmanoeitf  fee  logic.  By  inoorpoiating  fell  logic  shnubnioa.  feis  avdds  some  of  fee 
simplifying  assmnptim  dun  were  made  in  fee  pievioiis  studies.  The  method,  described  in 
section  23.1  below,  leUesiqion  fee  observation  dun  performance  and  alfenmiy  errors 
are  independent  Tto  is  true  because  altim^eiron  are  invisible  to  TCAS. ' 

The  net  altimetry  error,  x,  for  <»e  aircraft  has  a  protebilify  dmroty  whidi  is  iqiproximately 
Li^ilacian  (Doubte  Expcmential)  wife  aero  mean  and  a  parameter,  o,  that  is  a  ftinctimi  of  true 
altitude  and  the  presence  of  ’’correcdtxis"  carried  out  by  an  Air  Data  Computer^  (equation  1). 

f(x)»(2o)-*ejq)(:M)  1. 

Empirical  values  for  sigma  have  been  repmted,  fw  several  altitude  layers,  fOT  "ctnrected”  and 
"uncorrected"  altimeny  [3],  [4],  [6],  [7].  The  values  used  here  (in  feet)  are  presented  in 
tabfe  3.  Subsequent  calculations  are  based  upon  die  TCAS  aircraft  having  cmiected  altimetry 
and  the  other  aircraft  having  uncorrected  altimetry  60  percent  of  the  time.  This  partition 
reflects  the  observation,  in  the  database,  that  60  percent  of  the  intruders  were  GA  aircraft  [5]. 


Tables.  Altimetry  Error  Parameters 


L?  •^r 

Altitude  (ft.) 

Corrected  Altimetry 

Sigma 

Uncorrected  Altimetry 

1 

2300 

46 

67 

2 

5000 

48 

67 

3 

10000 

52 

75 

4 

20000 

65 

92 

5 

30000 

78 

105 

6 

35000 

86 

105 

^  Air  Data  Computers  are  present  on  carrier  aircraft  but  not,  usually,  on  lower  performance 
GA  aircraft. 
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2.4  T€ASEhK:OUNT£R$l»fllLATiONS 
2A.I  Simalatfoii  Diierijp4ion 

The  encounter  Initiator  [8]  performs  tqwatedsimidadaair  of  t^tecific^racoonter  geometries 
widi  numdous  panuneters  being  varied  on  suCCMsive  tms  to  i^ve  a  rich  samiHing  of  the 
muM-parameter  saihpte  space.  Evdysamfdemicoi^er  is  run  three  times:  without  TCAS, 
and  with  each  ahcraft  in  turn  carrying  mid  reqK»dh^to  id  TCAS,  with  die  other  aircraft 
unequipped.  The  same  mcounters  are  rerun  for  bodi  the  v6.0  and  v6.04  logic.  ;The  simulated 
TCAS  aircraft  responds  to  any  TCAS  RAs  ^irerated  accon&ig  to  a  model  which  also 
provides  a  range  of  statistical  variation.  Separations  ae  comf^cd  both  with  aiid  witbcnit 
TCAS  to  enable  the  tabulation  of  encounter  separation  statistics. 

The  simulation  uses  an  input  ftle  that  specifies  each  encounter  gemnetry  to  be  rlin.  Either  a 
single,  specific  case  can  be  run,  or  a  series  of  repetitions  can  provide  random  sampling  of 
many  parameters.  The  present  study  models  each  encounter  class  as  a  nominal  jcase,  and  uses 
parameter  distributions  to  specify  the  variations  in  aircraft  vertical  rates,  the  time  and 
magnitude  of  accelerations,  horizontal  speed,  and  miss  distance.  In  this  study,  Altimetry  error 
is  not  simulated;  instead,  its  effect  is  calculated  on  a  statistical  basis. 

The  simulation  models  the  relative  motion  of  the  two  aircraft  in  the  encounter  at  one-second 
intervals  ftom  50  seconds  before  until  40  seconds  after  their  closest  point  of  approach.  When 
one  aircraft  is  modeled  as  TCAS-equipped,  the  simulation  calls  the  TCAS  logic  and  passes  it 
nearly  all  of  the  inputs  that  would  be  made  available  to  that  logic  in  an  actual  installation. 
These  inputs  include  own  aircraft's  barometric  altitude  and  radar  altitude,  the  threat’s  repmted 
range  and  quantized  altitude  report,  and  own  aircraft's  climb-inhibit  status.  The  logic 
performs  its  normal  functions,  including  the  selection  of  sensitivity  level  and  the  associated 
logic  parameters,  threat  detection,  advisory  selection,  and  display.  This  simulation  does  not 
include  the  advisory  coordination  function;  accordingly,  encounters  against  TCAS-equipped 
threats  are  not  simulated  here,  but  are  described  separately  in  section  4.2. 

The  simulation  gives  the  option  of  testing  imperfect  surveillance  by  selecting  a  reply 
probability  for  the  threat  When  this  probability  is  set  to  less  than  unity,  each  surveillance 
reply  is  independently  determined  to  be  leceiv^  or  be  missed. 

The  path  of  the  TCAS-equipped  aircraft  is  modifted  to  reflect  the  pilot's  response  to  TCAS 
advisories.  For  this  study,  the  simulated  delay  is  varied  uniformly  over  4-6  seconds  for  an 
initial  advisory,  and  with  less  delay  in  responding  to  any  later  advisory.  The  accelerations 
used  are  nominally  0.25  g  in  responding  to  an  RA  and  for  returning  to  the  nominal  flight  path 
at  the  end  of  an  advisory.  The  nominal  value  0.33  g  is  used  for  "reversal"  or  "increase  rate" 
RAs.  Other  parameter  variations  in  the  system  account  for  transponder  noise  and  delay, 
surveillance  range  eaors  in  bias  and  jitter,  and  noisy  radar  altimeter  data. 


2.4JK  Enoountcr  Ifodd  Orc^m 


These  simulatkxis  requixe  modeling  that  tboroaghly  exerci^  the  logic  with  a  variety  of 
parameter  variatioiis  for  each  encounter  geometry.  Each  aircraft  uses  incfependendy  selected 
values  speed,  vertkal  rale,  and  maneuver  time,  where  qqnxqnriate.  Every  value  is  drawn 
landmnly  firom  the  distritHition  i^prc^aiate  to  its  jKttfUe. 

This  study  is  i^wciftcally  intended  to  measure  the  Ri^  Ratio.  Therefore,  oidy  encounters 
with  HMD  less  dian  SOO  ft  axe  relevant  The  model  forms  geometries  with  iAflD  varying 
over  0  to  SOO  ft  at  the  closest  point  of  approach. 

Encounter  simulations  ate  run  for  one  Oass  (Le.,  geometry)  at  a  time.  Each  set  of  tuns 
duplicates  the  geometry  for  ten  "bands”  of  vertical  separatimi  for  each  Oass.  Tlwse  bands 
represent  the  gecmietry's  nrxninal  vertical  separatum  (VMD)  without  TCAS  (ftgure  3).  To 
saturate  each  band,  SOO  encounters  are  run  in  each,  with  the  vertical  separation  randomly 
drawn  ftom  a  uniform  distribution.  The  first  baiul  uses  vertical  separations  at  CPA  from  0  to 
100  ft;  the  second  band  from  100  to  200  ft;  up  to  die  tenth  band  from  900  to  1000  ft. 

These  encounter  Qass  simulations  are  repeated  fof  each  of  the  six  altitude  layers  (table  3). 
for  which  TCAS  uses  different  logic  parameters. 

The  simulator  collects  the  vertical  separation  at  CPA  for  each  repetition,  both  with  and 
without  TCAS  (see  figure  4).  These  results  are  combined  as  described  in  the  next  section. 


2.5  CALCULATING  RISK  FROM  SIMULATION  RESULTS 

2.5.1  Combining  Effects  of  Logic  Performance  and  Altimetry 

The  simulation  output  (measuring  logic  performance)  is  collected  in  the  form  of  a  histogram 
of  IVMDI  over  a  range  of  zero  to  1,500  feet  (150  bands)  for  each  of  the  three  cases  of  interest 
(viz..  No  TCAS,  v6.0  and  v6.04).  The  total  NMAC  probability  for  the  class  is  the  sum  of  the 
(disjoint)  VMD  band  probabilities.  Taking  the  mich^^t  of  each  band  as  the  perceived 
separation,  S,  the  overlap  density  and  the  relative  ^quency  in  the  band  is  used  to  estimate 
the  probability  that  the  true  (unobserved)  vertical  separation  was  ^  100  feet  given  that  S  was 
observed  (see  figure  5).  The  overlap  density  is  the  convolution  of  the  respective  error 
densities  for  the  two  aircraft. 

The  total  altimetry  error  is  the  sum  of  two  random  errors.  Since  the  two  aircraft  errors  are 
independent,  the  probability  density  of  their  sum  equals  the  convolution  of  the  random 
variables.  In  this  case,  we  require  the  convolution  of  two  Laplacian  density  functions.  There 
are  two  cases  to  consider  depending  upon  whether  the  parameters  are  equal  or  unequal.  The 
convolution  in  the  former  case  has  been  reported  previously  [9].  It  is  given  in  equation  2.  In 
the  following  equations,  z  is  the  algebraic  sum  of  the  two  altimetry  errors. 
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Figure  3.  Encounter  Geometry  Repeated  Over  Several 
"Bands"  of  Vertical  Separation 

Each  geometry  class  is  rerun  many  times  to  measure  performance  at  each  narrow 
band  of  vertical  separation  at  CPA.  In  this  example,  the  band  from  300  to  400ft 
separation  is  shown.  Every  repetition  has  further  variations,  such  as  vertical  rates, 
accelerations,  and  maneuver  times.  Every  case  is  repeated,  with  each  aucrttfi  in 
turn  carrying  TCAS. 


Figure  4.  Perceived  Separation  Resulting  from  TCAS  RA 

The  simulation  runs  vary  parameters  such  as  pilot  response  times.  For  each  band 
that  is  run,  statistics  are  collected  comparing  the  vertical  separations  from 
responding  to  TCAS  RAs  to  those  without  TCAS.  A  single  encounter  is  illustrated. 
These  separatiots  only  represent  those  perceived  from  Mode  C  reports,  as  they  do 
not  include  any  effects  of  altimetry  errors. 


- Reported 

error 


error 

- Reported 


Figure  5.  True  Versus  Perceived  Vertioil  Separation  Due  to  Altimetry  Error 
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2. 


C(z)*(4o2)**  (lai  +  0)cxp(^) 

The  ccmvolutioa  for  die  case  of  unopial  parameters  is  given  in  equatirm  3  (see  appendix  D). 


C(2) 


Ol  * 


2  (of  - 


The  probability  that  the  tnie  vertical  separadcm  of  the  aircraft  is  ^  1(X)  feet  (an  NMAC)  can 
be  computed  using  equation  4.  Qosed-foim  solutkms  for  equation  4  have  been  (ditained  and 
verified  by 

JpSflOO 

i  CXz)  dz  4. 

s-ioo 

V  * 

comparison  with  the  results  of  Monte  Carlo  simulations  (see  ^pendix  D). 

An  example  of  the  effect  of  altimetry  error  on  NMAC  probability  is  illustrated  in  figw  6. 
This  figure  shows  the  probability  that  true  IVMDi  is  ^  1(X)  feet  as  a  function  of  perceived 

IVMDI.  The  example  is  for  altitude  layer  3  with  Oi  =  52  feet  and  02  =  75  feet. 


Perceived  Separation  (feet) 

Figure  6.  An  Example  of  the  Effect  of  Altimetry  Error  on  NMAC  Probability 
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Hgise  7  UlttttntBS  Ae  process  in  terms  of  vertical  sqMradon  statistics  for  the  ^  encounters 
nminaao^band  ^^<a)^iows  tiiatthecasesTiininAisbaikl  all  would  have  a  given 
IVMDI  (in  this  case  300  to  400  ft)  without  TCAS.  Put  (b)  shows  the  distribution  of  apparent 
separation  atorrespoochng  to  TCASRAs.  This  distribution  is  spread  around  a  mode  of 
about  600  ft  After  tqiplying  die  aldmetry  error  distribution  desc^bedtUxtve,  the  true 
separation  distribution  of  this  oi^ut  is  reflected  in  put  (d).  This  shows  that  the  distribution 
of  true  IVMDI  is  spread  over  a  wUier  range  than  was  die  perceived  distribution  of  (b).  This- 
ou^ut  dKMild  be  compared  widi  that  in  part  (c),  which  shows  the  distribution  altimetry 
eiTors  applied  to  the  No-TCAS  distribution  (a).  Then  for  the  distributions  (c)  and  (d),  the 
probabilities  of  IVMDI  <  100  ft  are  calculate  to  produce  the  respective  Nh^C  comptments. 
Using  TCAS  has  clearly  decreased  the  risk  in  this  case  (cme  of  tte  simulaticHi  runs  p^onned 
in  this  study). 

1S2  Combining  Results  for  Risk  Ratio 

This  section  describes  the  process  used  to  collect  the  results  of  the  many  simulated 
encounters  and  develop  an  overall  Risk  Ratio  statistic.  The  goal  is  to  compare  the  vertical 
separations  provided  by  the  two  logic  versions,  with  the  many  encounter  geometries  put  in 
proper  context  (i.e.,  more  common  cases  weighted  more  hea^y). 

The  Risk  Ratio  is  defined  by: 


Risk  Ratio  =  t>rob[NK1ACwithTC/iS] 

prob[NMAC  without  TCAS]  ^ 

Both  numerator  and  denominator  can  be  expanded  using  conditional  probabilities  in  the 
following  form  to  account  for  encounter  classes: 

prob  (NMAQ  =  prob  [NMAC I  class]  •  prob  [class]  5^ 

classes 


The  following  describes  the  procedure  for  determining  each  term  prob  [NMAC  I  class].  The 
vertical  separation  at  CPA  is  measured  for  each  simulation  run,  both  with  and  without  TCAS. 
The  statistics  are  tabulated  for  the  batch  of  500  encounters  in  each  band  of  VMD,  designated 
below  using  the  subscript  "v",  and  run  for  altitude  layer  L.  For  this  distribution,  the  altimetry 
error  model  is  applied  to  calculate  the  probability  that  true  separation  is  within  the  NMAC 
region.  This  is  done  twice;  for  threats  with  good  altimetry  and  for  threats  with  low  quality 
altimetry.  TCAS  is  always  assumed  to  carry  high  quality  altimetry. 

The  results  of  the  two  altimetry  calculations  are  combined  according  to  the  ratio  of  RA- 
producing  encounters  seen  in  the  ARTS  data:  60  percent  GA  fiow-quality  altimetry 
assumed)  and  40  percent  high-quality  altimetry.  Ihen  these  results  are  combined  for  the 
VMD  bands  according  to  the  fr^uencies  observed  at  each  site's  data  for  this  class  of 
encounters. 
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(c)  Output  -  No  TCAS  +  Alt.  Error  (d)  Output  -  TCAS  +  Alt.  Error 


Figure  7.  Effect  of  TCAS  and  Altimetry  Error  on  |VMD| 
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This  set  of  calctilatioiis  can  be  expiessed  mathemadcally  using  the  fdlowing  notation  with 
subset^  identifying  various  inobabilities: 

PrvLa*  Probal^ty  trfNMAC  using  TCASveisioaT,  in  VMD-bandv,  at  alt  layer  L, 
for  altimeny  quality  «  GB  or  GG  (Good  vs.  Bad  or  Good  vs.  Good). 

To  calculate  the  result  for  an  encounter  class  for  each  altitude  layer,  the  first  step  combines 
the  results  oi  the  two  calculations  for  altimetry  qual^,  again  using  oxiditional  probabilities: 

Pt  [Pv LOB  (0.6) +  Pv LOO  (0-^)1  Wv  7. 

v-l 

where  the  TCAS  version  (T)  has  been  omitted  from  equation  for  brevity.  The  Pv  lgb  and 
Pv  LGG  terais  are  the  risk  calculations  described  idx>ve  which  apply  altimetry  error  to  the 
perceived  separations.  The  Wy  values  represent  the  observed  VMD  frequencies  from  the 
ARTS  data  (i.e.,  without  TCAS),  tabulated  for  each  encounter  (!lass  (C^.  Figure  8  illustrates 
the  process  of  combining  these  v-weights. 

The  next  step  is  to  aggregate  the  results  of  the  simulation  runs  over  the  six  altitude  layers  for 
each  Qass  (C),  giving  the  prob  [NMAC  i  class]  from  above: 

6 

Pc=  S  Pl^l  8. 

Lsl 

This  process  is  illustrated  in  figure  9.  The  values  are  NMAC  frequencies  for  each  altitude 
layer.  These  values  are  altitudes  taken  from  the  historical  reports  of  NMACs.  This  was  the 
same  data  used  for  the  altimetry  studies  in  the  two  previous  Safety  Studies. 

(Note:  wt=l ) 

L 

Next,  calculate  and  aggregate  these  same  results  over  all  encounter  Classes  at  Site  S; 


X  Pc  Acs 


c 


where  the  values  ncs  are  the  actual  counts  of  RAs  in  each  Class  C  at  site  S.  These  counts 
represent  estimates  for  the  prob  [class]  terms.  This  Ps  is  the  desired  prob  [NMAC]  result. 
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Encounters  with 
VMO  within  a  bin 
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Figure  8.  Weighting  Results  for  Bins  of  Vertical  Miss  Distance 


Layer  Frequencies 
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Figure  9.  Combining  Results  for  Altitude  Layers 


An  investigatu»  was  perfonned  to  consider  adjustuig  the  psob  [class]  trams  to  account  for 
potential  c^jes  in  encoHin^  frequencies  for  die  small  range  of  represented  by  this 
calculatitm.  lite  actual  counts  of  RAs  coveted  a  wider  range  of  HMD.  A  contingency  table 
was  formed  which  compared  the  class  counts  at  small  HhG>  with  tito  class  counts  ci  ^  RAs. 
A  Chi-square  test  determined  that  the  h^totibesis  that  class  frequraicy  does  not  d^iend  <m 
HMD  ccMild  not  be  rejected.  Therefore,  having  determined  that  diis  distribution  not  bias 
the  class  weights,  no  adjusunent  was  made  in  the  class  counts. 

Finally,  the  NMAC  pttdiabilities  are  used  to  calculate  Risk  Ratios  for  the  various  TC AS 
equips^.  Denoting  the  logic  versions  by  the  nibscripts  6  and  6.04,  and  no-TCAS  by 
subscript  0,  the  following  form  the  Risk  Ratios  for  ea^  site  (S): 

rRj.Esa  ukI  RK^.e^  ,o_ 

Pso  "so 


2.6  FAULT  TREE  CALCULATIONS 


As  in  the  earlier  Safety  Studies,  the  calculation  of  NMAC  related  to  logic  performance  and 
altimetry  is  condition^  upon  many  factors.  The  Fault  Tree,  shown  in  figure  10,  provides  the 
structure  to  evaluate  the  relevant  factors  and  their  conditional  probabilities.  In  section  3.5, 
the  calculations  are  performed  using  the  same  mediod  as  in  the  earlier  studies,  accumulating 
the  joint  or  conditional  probabilities  of  event  chains  which  would  lead  to  a  NMAC. 
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SECTION  3 
RESULTS 


This  secdon  siimmaraes  the  fuidinp  in  categorizing  encounten  and  CKtractiag  dinrielevant 
parameten  for  modeling;  the  lesults  of  simulatkm  runs  of  the  varioas  encounter  clasm;  and 
the  results  d  the  process  of  calculating  die  Risk  Ratio  for  unequin^  dueats,  asnuning  die 
TCAS  RAs  are  followed.  The  Risk  R^io  results  are  presented  ftv  individual  sites  and  as  die 
average  d  die  sites. 


3.1  OBSERVED  ENCOUNTERS 

The  distribution  of  encounters  observed  and  the  smtistics  dmived  from  them  are  described 
below. 


3.1.1  Encounter  Class  Distribution 

The  class  distributions  of  encounters  and  RAs,  summed  over  all  eight  sites,  are  presented  in 
table  4.  "All  Encounters"  represent  pairs  which  pass  the  coarse  filtering  criteria.  The  "RAs" 
are  those  encounters  which  would  have  generated  a  RA  using  the  v6.0  logic.  The  RA 
columns  of  this  table  were  further  divid^  according  to  site,  in  order  to  compute  the  class 
weights,  ncs.  There  is  little  difference  in  the  class  distribution  of  "All  Encounters”  versus  the 
distribution  of  "RAs."  This  lends  validity  to  the  assumption  that  this  class  distribution  can 
characterize  the  encounter  environment,  and  is  not  sensitive  to  the  details  of  the  logic  version 
that  was  used  to  generate  the  "RAs"  set. 

Table  5  shows  the  site-by-site  comparison  of  RA  classes.  Considerable  differences  are  seen 
in  the  environments  represented  by  this  collecdon  of  sites.  For  example,  Leveloff  encounters 
(Class  13)  are  more  fr^uently  observed  at  Dallas  than  anywhere  else.  Level  encounters 
(Class  1040)  predominate  in  New  Yoik  and  Minneapolis-St  Paul.  Pairs  of  descending 
aircraft  (Qasses  4  and  14)  are  much  more  common  in  St.  Louis  and  Denver.  Altitude 
crossings  (Qasses  1  through  9)  are  moderately  frequent  at  Burbank,  where  more  GA  mix 
with  air  carriers  than  at  these  other  sites.  The  differences  of  this  environmental  mix  also  can 
be  seen  from  figure  1 1,  which  compares  the  proportions  of  some  of  the  larger  classes. 


3.2  SIMULATION  RESULTS 

The  basic  simulation  runs  performed  for  this  study  (exclusive  of  degraded  surveillance  or 
climb-  or  descend-inhibited  cases)  totaled  780,000  encounters  for  each  version  of  the  logic. 
These  runs  included  all  classes  with  up  to  one  maneuver,  which  represented  98  percent  (1849 
of  1889)  of  the  RAs  in  the  database. 
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Talile4.  &icoimter>Clafli  Distrttratkias 


Class 

1  All  Encounters 

1  Freauency  Percent 

Percent 

1 

291 

17 

129 

6.8 

2 

26 

0.2 

7 

0.4 

3 

43 

0.4 

21 

1.1 

4 

189 

1.8 

90 

4.8 

5 

48 

0.4 

23 

1.2 

6 

37 

0.3 

17 

0.9 

7 

4 

0.04 

2 

0.1 

8 

6 

0.1 

5 

0.3 

9 

2 

0.02 

1 

0.1 

1(H0 

3512 

318 

659 

34.9 

11 

3069 

28.7 

331 

17.5 

12 

753 

7.0 

131 

6.9 

13 

941 

8.8 

158 

8.4 

14 

964 

9.0 

213 

11.3 

15 

324 

3.0 

37 

2.0 

16 

324 

3.0 

33 

1.7 

17 

45 

0.4 

7 

0.4 

18 

74 

0.7 

13 

0.7 

19 

46 

0.4 

12 

0.6 

Total — > 

10698 

100 

1889 

100 
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Tables.  Percentage  Encounto*  Classes  by  Site  (RAsOnly) 


Qass 

BUR 

CST 

DEN 

DFW 

JFK 

MSP 

SEA 

STL 

1 

10.9 

9.6 

3.5 

3.4 

10 

4.3 

5.3 

18 

2 

0.0 

0.4 

1.1 

0.0 

0.0 

1.0 

0.0 

0.0 

3 

0.7 

1.8 

1.1 

0.0 

1.0 

1.0 

1.5 

0.9 

4 

5.0 

1.8 

11.3 

2.7 

0.0 

1.9 

5.3 

12.0 

5 

1.4 

1.8 

1.8 

0.0 

1.0 

1.0 

0.0 

0.0 

6 

1.7 

1.0 

1.1 

0.0 

0.0 

0.0 

0.8 

0.9 

7 

0.0 

0.0 

0.4 

0.7 

0.0 

0.0 

0.0 

0.0 

8 

0.2 

0.2 

0.7 

0.0 

0.0 

0.5 

0.0 

0.0 

9 

0.2 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

10+0 

22.6 

44.1 

24.4 

25.2 

65.3 

57.1 

37.6 

7.4 

11 

28.0 

14.9 

9.2 

22.4 

15.3 

7.6 

28.6 

11.1 

12 

6.9 

8.2 

7.1 

6.1 

6.1 

8.6 

5.3 

1.9 

13 

8.1 

8.6 

3.5 

29.9 

6.1 

5.2 

4.5 

4.6 

14 

5.5 

3.3 

30.1 

4.1 

1.0 

8.1 

6.8 

51.9 

15 

3.8 

1.6 

0.7 

4.1 

1.0 

1.4 

0.8 

0.0 

16 

2.4 

0.8 

2.5 

0.7 

1.0 

1.0 

2.3 

4.6 

17 

0.7 

0.4 

0.4 

0.0 

0.0 

0.5 

0.0 

0.0 

18 

1.2 

0.6 

0.7 

0.7 

0.0 

0.0 

0.8 

0.9 

19 

0.7 

0.8 

0.4 

0.0 

0.0 

1.0 

0.8 

0.9 

#RAs 

421 

490 

282 

147 

98 

210 

133 

108 
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The  simulations  of  the  various  encounter  classes  at  each  altitude  layer  produced  distributions 
of  vertical  separation  that  were  substantially  equal  to  the  intended  separation.  This 
separation,  designated  by  the  value  of  the  logic  parameter  ALIM,  is  decreased  somewhat  in 
v6.04. 

Figure  12  provides  a  three-dimensional  view  of  this  large  body  of  data.  Parts  (a)  through  (0 
of  the  figure  compare  the  vertical  separation  results  in  altitude  layers  1  through  6, 
respectively,  for  a  single  encounter  class  (class  1 1).  Part  (g)  combines  all  these  data  in  a 
single  plot,  showing  that  the  greatest  mass  of  the  separation  increases  for  the  higher  layers,  as 
is  the  intent  of  the  logic. 

These  plots  are  highly  informative  in  showing  that  vb.CW  produces  marginally  smaller 
separation,  as  designed,  and  with  a  very  small  number  of  encounters  with  small  separation 
relative  to  those  with  normal  separation.  In  addition,  it  is  important  to  observe  that  these 
results  were  generated  for  uniform  numbers  of  trials  at  every  band  of  vertical  separation 
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8  g  §  § 


Figure  12.  Simulation  Results  by  Altitude  Layer:  Perceived  Vertical  Separation 
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Class  1 1  View  1 


Figure  12.  Simulation  Results  by  Altitude  Layer: 
Perceived  Vertical  Separation  (Concluded) 


(before  TCAS  acted).  The  risk  calculations  perfOTmed  below  combine  these  results  in  the 
proper  proportions.  This  combination  cannot  be  intuitively  estimated  by  observing  the  graph 
alone. 

The  simulation  results  apply  to  apparent  separation,  bef(C»e  considering  the  effects  of 
altimetry  error.  While  tlwse  results  alone  are  not  sufficient  to  assess  risk,  they  provide  insight 
regarding  tfie  effectiveness  of  the  logic  overall,  as  well  as  for  particular  encounter  classes. 

Figures  13  and  14  show  the  performance  of  the  v6.04  for  encounter  classes  13  and  14 
respectively.  The  performance  for  the  other  classes  simulated  are  shown  in  appendix  C. 
These  figures  compare  the  fraction  of  NMACs  that  resulted  fw  the  runs  performed  at  each 
altitude  layer.  The  bars  labeled  "Unresolved"  give  the  fraction  of  NMACs  without  TCAS 
that  TCAS  did  not  resolve.  The  bars  labeled  "Induced"  give  the  fraction  of  non-NMACs  that 
became  NMACs  after  using  TCAS. 

For  class  13,  about  94  percent  of  NMACs  were  resolved  in  layer  1,  increasing  to  over 
99  percent  in  layers  2  and  3,  and  100  percent  in  the  higher  layers.  The  induced  cases 
represent  less  than  1  percent  of  each  layer,  decreasing  to  about  0.1  percent  in  the  higher 
layers.  For  class  14, 97  percent  of  NMACs  were  resolved  in  layer  1,  and  99.9  to  100  percent 
in  the  higher  layers.  The  largest  induced  bar  for  this  class  represents  .06  of  one  percent. 

These  figures  reflect  a  simple  summing,  rather  than  a  weighted  combination,  of  the  various 
VMD  bands.  The  heights  of  these  bars  must  be  adjusted  by  weighting  before  a  risk 
computation  may  be  made.  However,  they  arc  useful  in  comparing  the  results  of  the  layers. 
They  show  that  layer  1  has  far  more  NMACs  than  the  other  layers.  (Recall  that  equal 
numbers  of  encounters  were  simulated  for  each  layer.)  This  salient  pattern  is  repeated  in 
every  encounter  class.  The  data  also  shows  that  most  of  the  failures  come  from  Unresolved 
NMACs.  Only  a  few  classes  have  a  substantial  number  of  Induced  NMACs,  and  even  for 
these  classes,  only  a  few  VMD  bands  are  susceptible. 


3.3  CALCULATION  OF  COMBINED  ALTIMETRY  AND  LOGIC 
PERFORMANCE 

This  section  presents  the  results  of  the  process  described  in  section  2.5,  which  calculates  the 
Risk  Ratio  component  due  to  the  combined  effects  of  logic  and  altimetry  errors.  This 
calculation  assumes  all  RAs  are  followed.  The  calculation  is  done  for  each  of  the  eight  sites 
using  both  the  encounter  class  distributions  and  the  vertical  weight  distributions  within  each 
class  as  observed  at  that  sitc.^  In  addition,  an  average  figure  is  develojjed,  which  is  based  on 
averaging  the  class  weights  and  IVMDI  across  sites. 


3  As  discussed  in  Sections  2.3.2  and  3. 1.1,  the  class  distributions  and  weights  are 
independent  of  the  version  of  logic. 
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Fraction  of  Runs  Fraction  of  Runs 

Producing  NMAC  Producing  NMAC 


Class  13  V  6.04  Logic 


1  2  3  4  5  6 


Layer 

Figure  13.  NMAC  Statistics  for  Simulations  of  Class  13 


Class  14  V  6.04  Logic 


Figure  14.  NMAC  Statistics  for  Simulations  of  Class  14 


TaMe  6  shows  that  this  component  of  Risk  Ratio  increases  by  2.8  percent  for  the  "average" 
harin  used,  ranging  fam  0.8  percent  to  4.4  percent  tt  the  ei^t  sites.  This  is  of  the  same 
Older  as  tibe  variation  of  tbe  Risk  Ratio  among  sites  for  die  present  v6.0  k^ic,  which  vanes 
from  0.8  pocmit  to  S.l  percem.  Risk  Ratios  are  a  means  of  comiwison  to  the  NMAC  risk 
prior  to  TCAS;  the  values  disciisaed  here  are  U  to  2  onlers  of  magnitiide  smaller.  TheFault 
Tree  calculations  ia  sectioa  3J  make  use  of  this  component  of  Ri^ 

Since  it  was  observed  in  section  3.2  that  v6.04  performance  in  layer  1  was  markedly 
degraded  relative  to  the  odier  layers,  the  Risk  Ratio  Component  was  recalculated  for  layn  1 
akme,  and  for  layers  2-6%  excluttog  1.  The  results,  shown  in  table  7,  indicate  fhat  the  logic 
versions  me  considerably  closer  in  performance  for  layers  2-6. 


Tabled.  Ride  Ratio  Increment  by  Site 


Site 

Risk  Ratio 
Component  V  6 

Risk  Ratio 
Component  V  6.04 

Increment  In  Risk 
Ratio  Componmit 

Burbank 

.0279 

.0724 

Coast 

.0514 

.0595 

.0081 

Denver 

.0130 

.0377 

.0247 

Dallas-Ft  Worth 

.0181 

.0513 

.0332 

New  York  (JFK) 

.0097 

.0340 

.0243 

Minneapoli$-St  Paul 

.0121 

.0398 

.0277 

Seattle 

.0129 

.0410 

.0281 

St  Louis 

.0085 

.0271 

.0186 

Average 

.0145 

.0429 

.0284 

Table  7.  Risk  Ratio  Increment  by  Altitude  Layer 


Layer 


- 

1  only 
2-6  only 


Risk  Ratio 
Component  V  6 
.0145 
.0204 
.0135 


Risk  Ratio  Increment  in  Risk 
Component  V  6.04  Ratio  Component 
.0429  .0284 

.1170  .0966 

.0306  .0171 
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34  SEI^^IVFTY  STUDIES 
3^4.1  finpcrfBCtSurvefflanet 

Sevoal  encounter  feometries  were  renin  with  the  probability  of  TCAS  supeillance 
delivering  a  Mode  C  report  set  to  0.9  and  0.8  resp^vely.  The  value  0.8  is  jud^  to  be  a 
reasonidile  "worst-case"  probabili^  of  receiving  reports  ttowgh  a  high  densiQf  interference 
environineat.  The  Risk  Rado  components  calculate  fitomdiesenMis  were  compared  with 
die  componem  using  pei£ect  le^y  probabiliQr. 

Hgure  IS  illustrates  these  results.  In  part  (a)  of  die  figure,  crossing  encounters  of  class  1 
were  run  at  layer  3  (7000  ft  altitude).  Performance  d^rades  mars^nally  with  surveillance 
quality,  while  the  increment  of  Risk  Ratio  changes  fioin  about  me  percent  to  1.5  percent. 

Part  (b)  the  figure  shows  results  for  leveled  encounters  of  class  13  also  run  at  layer  3.  Fw 

these,  the  Risk  Rado  component  actually  improves  sli^dy  for  this  marginally  degraded 
surveillance.  This  result  reflects  larger  separadms  behig  generated,  possibly  mrae  than 
necessary  in  smie  cases.  Most  sign^cant  is  that  the  increment  in  Risk  Rado  from  the 
version  6.04  logic  closely  matches  in  bodi  gemietries. 

These  results  indicate  that  imperfect  surveillance  quality  will  not  have  a  significant  effect  on 
the  reladve  performance  of  these  logic  versions. 

3.4  J  Restricted  Maneuver  Capability 

Several  encounter  geometries  were  rerun  using  v6.04  to  study  the  effects  of  TCAS  resoludon 
when  the  TCAS  aircraft  is  unable  to  climb  or  to  descend.  The  logic  takes  account  of  these 
conditions  when  selecting  an  advisory. 

Climb-inhibited  Cmdition 

The  climb-inhibited  condition  was  simulated  for  several  geometries  in  altitude  layer  6,  using 
the  corresponding  logic  parameters.  As  in  the  normal  case,  each  aircraft  in  the  encounter  was 
simulated  in  turn  to  carry  TCAS. 

Degraded  performance  was  observed  for  geometries  in  which  the  "higher"  aircraft  carried  the 
TCAS  and  in  which  the  threat  passed  closely  (c.g.,  ICX)  to  3(X)  ft)  below.  Where  TCAS  wtild 
rxM  achieve  good  separatim  with  a  crossing  maneuver,  and  yet  was  unable  to  issue  a  "Climb" 
advisory,  tire  existing  separation  often  was  unchanged. 

The  climb-inhibited  condition  is  expected  to  be  extremely  rare.  In  this  altitude  regime,  where 
standard  vertical  separations  are  2000  ft,  such  close  passages  are  infrequent.  Furthermore, 
only  a  few  combinations  of  aircraft  and  flight  regimes  have  been  identified  as  inhibiting 
TCAS  Climb  advisories.  No  measurable  effect  on  the  average  risk  calculation  is  expected. 
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■V6  □V6.04 


Surveillance  Reply  Probability 


(a)  Crossing  Encounters 


■V6  □V6.04 


0.06 


Surveillance  Reply  Probability 

(b)  Leveloff  Encounters 

Figure  15.  Logic  Comparison  for  Imperfect  Surveillance 
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Descend-inhibited  condition 

The  descend-inhibited  condition  applies  within  a  narrow  al  idc  band  in  the  lowest  altitudes 
where  TCAS  generates  RAs.  The  logic  docs  not  issue  "De  id"  advisories  that  would 
produce  close  proximity  with  the  ground.  Several  geomeu  /ere  simulated  at 
approximately  1000  ft  altitude  above  ground  level  (AGL),  usi.  g  the  correspOTding  logic 
parameters  for  layer  1.  The  results  were  compared  to  the  "normal"  layer  1  simulations 
performed  at  2000  ft 

The  descend-inhibited  simulations  showed  severely  degraded  results  when  TCAS  was  the 
"lower"  aircraft  in  the  encounter,  and  was  only  several  hundred  feet  above  the  lower  limit  of 
its  operating  regime.  In  this  situation,  TCAS  cannot  issue  a  "Descend"  advisory,  and  due  to 
the  short  warning  time  at  low  altitudes,  cannot  achieve  adequate  separation  with  a  nominal 
climb.  Consequently,  TCAS  is  often  ineffective  in  changing  the  pre-existing  vertical 
separation.  It  is  anticipated  that  this  effect  is  a  strong  function  of  the  height  above  the 
descend-inhibit  region. 

The  descend-inhibited  condition  only  applies  over  a  small  band  of  low  altitudes.  Its  effect  on 
safety  is  somewhat  like  extending  the  "TA-only"  mode  higher  for  certain  aircraft  in  certain 
geometries.  Further  work  must  be  performed  to  measure  the  change  as  a  function  of  altitude. 

3.5  FAULT  TREE  CALCULATIONS 

This  section  collects  the  various  elements  contributing  to  NMACs  and  calculates  their  total 
probability  relative  to  the  NMAC  risk  without  TCAS.  The  process  draws  upon  the  original 
fault  tree  developed  for  the  TCAS  Safety  Study  [3],  with  certain  changes  to  account  for  the 
more  sophisticated  analysis  of  logic  performance. 

The  original  fault  tree  (figure  16a  shows  a  simplified  version)  separated  NMAC  events  into 
two  categories  termed  "Unresolved"  and  "Induced."  These  categories  respectively  referred  to 
events  that  would  have  been  NMACs  without  TCAS  and  which  TCAS  did  not  prevent;  and 
those  that  would  not  have  been  NMACs  except  for  following  TCAS  advisories.  In  these 
earlier  studies,  the  Unresolved  category  included  items  such  as  threat’s  lack  of  Mode-C 
equipage,  surveillance  failure  to  track,  and  altimetry  error.  The  Induced  category  included 
erroneous  RAs  due  to  altimetry  error,  stuck  C  bits,  and  maneuvering  intruders. 

The  present  study  examines  TCAS  logic  performance  in  a  more  comprehensive  manner  and 
recognizes  that  some  of  the  resulting  NMACs  cannot  be  meaningfully  categorized  as  either 
Unresolved  or  Induced.  An  example  would  be  an  encounter  for  which  the  maneuver  in 
response  to  an  RA  provides  200  ft  perceived  separation,  while  altimetry  errors  negate  this 
separation,  resulting  in  true  separation  less  than  100  ft.  In  this  example,  both  logic 
performance  and  altimetry  errors  contributed  to  the  NMAC;  the  earlier  methods  would  not 
have  counted  it  at  all. 
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NMAC 


Unresolved  Induced 


No  Altimetry  RA  Not  Bad  Altimetry  Stuck 
Track  Followed  RA  Bit 


Figure  16a.  Previous  Fault  Tree  Structure  (Simplified) 


NMAC 


No  Bad  RA  Stuck  RA  Not  Coordination 
Track  and/or  Bit  Followed  Failure 

Altimetry 

Figure  16b.  Revised  Fault  Tree  Structure 

Ineffective  Resolution  Advisories  and  Altimetry  Errors  have  been  combined  into  a 
single  category.  The  distinction  between  Unresolved  and  Induced  NMACs  is 
removed  for  logic-related  causes.  The  new  causes  ofRAs  not  followed  and  of 
failures  in  TCAS-TCAS  coordinated  encounters  have  been  added. 
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Accordingly,  dus  study  drcq>s  the  distinction  between  Umesoived  and  Induced  NMACs  for 
cases  relai^  to  altiinetiy  and  logic  performance,  and  lemrai^s  the  fault  tree  as  in 
figure  16b.  The  irew  fault  tree  ^  ctmtains  the  same  fidlure  ptths,  ami  cletaiy  distinguidMs 
those  NMACs  which  are  unresolved  due  to  the  threat's  lack  of  Mo^  C  equi|»ige  from 
NMACs  resulting  from  altimetry  and  loj^  perfonnance  effoctt.  Both  vernons  are 
ccnnpaied  using  this  new  fault  tree. 

Hgure  17  foows  die  evaluation  of  the  fault  tree.  The  pttdiability  of  each  event  is  sdiown,  with 
each  boxed  value  indicating  die  compound  probabifii^  for  ach^  of  NMAC  events.  These 
are  summarized  in  the  tables  below.  Events  and  boxes  that  pertain  to  logic  show  values  for 
each  version.  The  chains  that  do  not  end  with  boxed  numbm  rejnesent  successful 
resolution. 

In  the  following  tables,  the  key  factors  and  their  probabilities  used  in  the  fault  tree  are  listed, 
followed  by  the  NMAC  probabilities  (boxed  values)  fiom  the  fault  tree.  They  are  totaled  in 
the  Summary  section  below  to  produce  the  final  risk  figure  for  the  ccmdition  of  all-RA's 
followed. 

1.  Unresolved  NMAC  related  to  threat's  lack  of  Mode  C  equipage 

This  category  is  the  same  for  both  logic  versions.  The  equipage  figures  are  the  same  ones 
used  in  the  1988  study  for  the  case  called  "Mode  C  NPRM"  [4,  appendix  H].  The  FAA 
subsequently  adopted  the  rule  requiring  Mode  C  carriage  in  certain  aircraft  categories  and 
certain  airspace;  ^erefore,  these  figures  should  now  become  the  baseline  case. 


Factor  Probability 

Threat  has  no  transponder  0.02 

Threat  has  Non  Mode  C  transponder  0.10 

Mode  C  equipped  0.88 

TA  issued  0.94 

Visual  conditions  permit  acquisition  0.70 

Visual  acquisition  made  by  IS  sec  0.83 


EVENTS 

RISK  RELATIVE  TO  NO  TCAS 

Threat  has  no  transponder 

.02 

Threat  has  Non  Mode  C  transponder  AND  TA  not 
given 

.006 

Threat  has  Non  Mode  C  transponder  AND  TA  issued 
AND  visual  conditions  do  not  permit  acquisition 

.0282 

Threat  has  Non  Mode  C  transponder  AND  TA  issued 
AND  visual  conditions  good  AND  no  visual 
acquisition  made  by  IS  sec 

.0112 
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VIlMl 


Figure  17.  Evaluation  of  Fault  Tree 


2.  Unresolved  NMAC  related  to  Surveillance  limitations 

This  category  is  the  same  for  both  logic  versions.  Hie  contributOTS  are  the  Mode  C  equipage 
and  TCAS  surveillance  failure  to  track  &  threat  so  that  a  timely  RA  is  not  issued.  The 
surveillance  failure  refers  to  the  failure  to  issue  a  timely  RA  against  a  Mode  C  dueat  (not 
Mode  S),  and  intentionally  overstates  the  probability  of  failure  because  this  probability 
decreases  as  the  range  to  a  collision  threat  decreases.  This  would  create  an  increased  chance 
to  resolve  the  encounter  with  a  late  RA,  but  no  such  credit  is  taken  here. 

Factor  Probability 

Mode  C  surveillance  fails  to  track  threat  .03 
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Mode  C  damn  AMD  no  RA  ^ued  due  to 
surveillaiKe  faRuiE  to  unck 

llllllllIHliillKijS^ 

X  NMAC  related  to  attbaatry  and  loil^pcrfDriQaace 


This  category  i^ltes  the  results  of  die  smiidatiqn  of  pnformance  and  aldratery  errors 

to  the  same  used  in  the  fault  tree  of  die  1988  study.  The  given  for  Lc^c  and 
Altimetry  effects  represent  the  nte  averages,  and  are  baa^  upon  TCAS  RAs  always  being 
followed. 


Factor 

TA  alerted  pilot  prior  to  RA  being  issued 
Visual  acquisition  by  IS  s  before  CPA 
Logic  and  alumetry  give  <  100  ft  separatkxi 
C-bit  error  causes  <  100  ft  separation 


.97 

.83 

.014 

.002 


Proiiability 

(v6.0)  .043  (v6.04) 


EVENTS 

RISK  RELATIVE  TO  NO  TCAS  | 

v6.0 

V6.04 

Small  separation  AND  no  TA  given 

.0004 

.0012 

Small  separation  AND  TA  given  AND 
visual  conditions  do  not  permit  acquisition 

.0041 

.0115 

Small  separation  AND  TA  given  AND 
visual  conditions  good  AND  no  visual 
acquisition  made  by  15  sec 

.0016 

.0046 

Summary 


v6.0 

v6.04 

Unresolved  NMAC  related  to  non-logic 
factors  (Sum  of  Parts  1  and  2  above) 

.0918 

.0918 

NMAC  related  to  altimetry  and  logic  (Sum 
of  Pan  3  above) 

.0061 

.0173 

TOTAL 

.0979 

.1091 

These  results  show  that  logic-related  NMACs  are  small  compared  to  residual  risks  not  related 
to  the  logic.  Figure  18  illustrates  the  relative  propomdons.  The  change  to  v6.04  has  little 
impact  on  the  toul  risk.  The  contribution  of  non-logic  related  factors  (Mode  C  equipage, 
surveillance,  visual  acquisidon)  dominates  the  altimetry  and  logic-related  factors.  TTie  result 
shown,  based  upon  the  site  average  figures,  gives  an  increment  of  rqrproximately  one  percent 
of  the  no-TCAS  risk.  This  result  is  fairly  consistent  for  all  the  sites  studied;  the  largest  site 
increment  is  1.7  percent.  Obviously,  even  a  small  degradation  in  protection  would  not  be 
recommended  were  it  not  more  than  compensated  by  the  benefits  sought. 
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□  Logic  S0id  Aithrnetry- 
reiatad  NMAC  (assumes 
att  RAs  followed) 

B  Eqi4|M^and 
surveillance-related 
NMAC 


•«  i 

^  I 

'  I 


TCAS  V  6 


TCASV6.04 


Figure  18.  Risk  Ratio  Components 


If  the  result  were  recalculated  for  altitude  layers  2-6  only,  using  the  data  from  table  7  above, 
the  one  percent  difference  would  become  0.65  poccent  The  logic  differences  are  quite  small 
in  these  layers,  the  greatest  part  of  risk  increment  being  contributed  by  layer  1. 

Of  the  small  part  of  Risk  Ratio  that  is  logic-related,  only  a  fraction  is  TCAS-induced, 
section  3.2  showed  that  unresolved  NMACs  form  the  majority  of  the  NMAC  encounters  seen 
in  simulation. 

It  must  be  emphasized  that  these  calculations  are  based  on  the  condition  that  all  TCAS  RAs 
are  followed  except  those  for  which  the  pilot  can  recognize  that  to  follow  the  RA  would  be 
unsafe.  The  next  section  makes  important  observations  that  modify  these  results  for  more 
realistic  conditions  related  to  the  fr^uency  of  following  RAs. 
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SECTION  4 


SPECIAL  ANALYSES 


This  section  ccmtaiiis  anafyses  the  two  major  bcanches  die  Fttik  TVee  that  weie  not 
included  in  the  modeling  and  simulation  inocess  described  in  sections  2  and  3.  SectitMi  4.1 
analyzes  die  effects  <m  safety  pilots  not  com{dyingwkh  their  TCASRAs.  Section4.2 
analyzes  the  safety  aqiects  ctfTCAS'TCAS  cooidinated  encounters. 


4.1  EFFECTS  OF  NOT  FOLLOWING  RESOLUTION  ADVISORIES 

The  simulation  analysis  described  above  applies  to  conditions  where  TCAS  RAs  always  are 
followed,  unless  visually  recognized  as  unsafe  to  do  so.  However,  early  operational 
experience  using  v6.0  of  TCAS  has  shown  the  need  fmr  a  better  match  with  normal  ATC 
operations,  and  that  some  significant  fractitm  of  TCAS  RAs  are  not  followed.  This  section 
discusses  the  implications  of  such  actions  on  calculating  TCAS  safety.  Observations  also  are 
given  below  regarding  the  potential  for  improving  the  realized  level  of  safety  with  the  new 
logic  v6.04. 

Figure  19  is  a  conceptual  illustration  of  the  variatitm  of  average  NMAC  risk  according  to  the 
fraction  of  TCAS  RAs  that  are  followed.  This  analysis  assumes  that  this  fraction  is  the  same 
for  all  "close"  TCAS  encounters  that  represent  NMAC  risk.  Also,  it  does  not  apply  in  the 
special  circumstance  of  TCAS-TCAS  coordinated  encounters,  which  are  discussed 
separately. 

The  variable  plotted  along  the  x-axis  represents  the  fraction  of  RAs  followed,  excluding  any 
cases  for  which  the  pilot  can  visually  recognize  that  the  RA  would  be  unsafe  to  follow  (for 
example,  excessive  altimetry  error).  For  all  the  other  RAs,  the  pilot  cannot  recognize  any  as 
unsafe,  but  might  not  follow  the  RA  for  various  reasons.  These  causes  may  include 
inattention,  distraction,  incompatibility  with  own  intentions,  incompatibility  with  ATC 
clearance,  pilot's  selection  of  another  resolution,  or  recognition  that  the  encounter  will 
achieve  safe  separation  without  a  maneuver.  However,  in  the  context  of  Risk  Ratio,  only 
NMAC  encounters  or  other  close  encounters  are  considered.  "Nuisance"  encounters  that  are 
clearly  safe  are  not  included;  RAs  that  are  not  followed  for  such  encounters  do  not  apply 
(except  possibly  to  influence  pilot  tendencies). 

The  figiue  shows,  as  more  RAs  are  followed,  TCAS  provides  a  successively  increasing  level 
of  effectiveness,  with  former  NMACs  resolved,  and  a  corresponding  decrease  in  the 
remaining  risk.  Although  the  logic  and  altimetry-related  NMACs  increase,  their  frequency  is 
considerably  lower  than  the  non-logic  related  unresolved  NMACs. 
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0%  100% 

Percentage  of  RAs  FoHowed 

Figure  19.  NMAC  Risk  Accordii^  to  Fraction  of  RAs  Followed 


Figure  20  is  another  conceptual  illustration  comparing  the  relative  risk  without  TCAS  to  the 
remaining  risk  upon  using  TCAS  v6.0  and  v6.04  when  all  RAs  are  followed  ftxr  each  version. 
(The  figure  is  not  drawn  to  scale.  Figure  18  above  shows  the  connect  proportions.) 


Percentage  of  RAa  Followed 

Figure  20.  Relative  Risk  for  100  Percent  of  RAs  Followed 
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Hgine  21  Ofverlays  die  continiKws  vviatioo  finm  figure  19  acito  die  eod^pdnts 
These  lines  compaie  die  deoease  in  Risk  for  die  two  venkxis  of  logic  when  tieatiiig  the 
fiactic»ofRA3f(dlowedasaoc»tiniioiisva^^  The  scale  is  exaggerated  for  dtfity  in 
iUustndng  die  folkradii^  concept.  At  any  constant  ralue(rfRAsfoBowed,v6.04  has  higher 
xi^  however»obsme  that  for  die  point  where  "X"  percent  of  RAsaiefidlowedosingtte 
present  (v6.0)  k^.  there  is  a  coneqiooding  point  bdieled  T"  percent  where  the  v6.04  logic 
has  identical  Risk.  Since  die  d.04  lo^  is  intraded  to  diminate  most  nuisance  alerts,  it  is 
anticipi^  that  TCAS  advisories  will  be  followed  more  fiequendy  using  v6.04.  Theiefore.  it 
would  require  (Mily  a  small  increase  in  diis  rate  to  achieve  a  lower  risk  in  practice  dtan  is  now 
being  acl^ved  using  v6.0. 

Figure  22  shows  the  actual  plot  of  the  site  average  Risk  variation,  drawn  to  scale.  This  figure 
uses  as  its  ent^xunts  the  Ri^  Ratio  result  dutt  was  computed  in  section  3.S  for  the  conditkm 
of  all  aircraft  following  their  advisories.  The  two  curves  are  extremely  close  to^dier, 
reflecting  die  dcmiinance  of  nmi-logic  contributors  to  risk,  jnincipally  non-transponder  and 
non-Mo^  C  equipped  aircraft,  and  TCAS  Mode  C  surveillance  limitations.  For  these 
curves,  even  a  one  percent  imrrease  in  the  percentage  of  RAs  followed  would  improve  the 
overall  risk.  A  five  percent  increase  in  the  percental  of  RAs  followed  would  decrease 
overall  risk  by  about  four  percent  Even  if  the  logic-related  portion  of  these  curves  were 
somehow  nonlinear,  the  variation  would  be  much  less  than  four  percent 


Figure  21.  Risk  Comparison  With  Different  Compliance 
for  Alternate  Logic  Versions 
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4.2  COORDINATED  ENCOUNTERS 

The  conventional  approach  to  TCAS  Safety  treats  the  risk  as  negligible  for  those  encounters 
where  both  aircraft  are  TCAS-equipped  Since  the  logic  ensures  the  selection  of  coordinated 
RAs,  the  risk  of  NMAC  should  be  extremely  remote.  This  section  examines  second-order 
effects  and  develops  a  more  tangible  estimate  of  this  risk. 

In  a  TCAS-TCAS  encounter,  an  NMAC  could  result  if  any  of  the  following  were  to  occur 

1.  One  TCAS  failed  to  track  the  other  AND  another  failure  chain  occurred  as  in  a  TCAS 
vs.  non-TCAS  encounter. 

Some  of  the  subcases  in  this  category  include: 

•  One  TCAS  failed  to  track  the  other  AND  maneuvered  to  thwart  the  other  TCAS' 
escape  maneuver.  (This  failure  is  unique  since  the  logic  does  not  issue  reversals 
against  a  TCAS  threat) 
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•  Both  TCAS  M  to  track  the  other  and  die  geomeay  teads  to  an  NMAC 

2.  The  Modes  Air-Air  Cooidinttioa  Link  failed  AND  both  TCAS  units  display^ 
incompatible  advisories  (such  as  CLIMB  for  both  aircraft)  AND  die  incomi^bility 
was  not  delected  ud  revised  in  a  timely  way  AND  the  geometry  was  such  that  th^ 
maneuvers  could  cause  a  NMAC. 

3.  After  successfid  coordination,  die  pilot  one  aircraft  followed  a  TCAS  advisory 

while  the  pilot  of  the  other  aircraft  foiled  to  lesprmd  to  die  TCAS  advisory  or  selected 
a  maneuver  incrxnpatible  with  die  first  TCAS*  lesrdution.  i 

4.  The  two  TCAS  units  coordinated  normally,  both  RAs  were  followed,  and  the 
resulting  maneuvers  brought  about  a  NMAC 

The  following  subsections  address  these  situations. 

4.2.1  Surveillance  Failure 

MIT  Lincoln  Labtxatory  has  studied  the  Mode  S  surveillance  results  of  flight  testing  and 
determined  [10]  that  for  a  Mode  S  threat  with  diversity  antennas  (as  a  TCAS  n  threat  would 
have),  the  probability  of  track  acquisition  would  be  at  least  .999  and  the  subsequent 
probability  of  receiving  each  updated  report  would  be  at  least  .99.  These  figures  apply  within 
a  12  nmi  range,  and  improve  considerably  with  range  closure.  They  apply  only  to  the  link 
reliability,  and  do  not  consider  aircraft  that  cannot  be  tracked  because  of  an  illegal  Mode  S 
address,  or  an  address  duplicating  TCAS'  own  address — such  a  probability  should  become 
remote,  and  is  difficult  to  estimate. 

With  this  probability  of  a  surveillance  failure,  the  probability  is  of  the  order  10*^  or  lower  that 
either  TCAS  would  fail  to  track  the  other,  or  would  lose  track  before  issuing  an  RA.  This 
probability  multiplies  the  various  risks  that  apply  to  encounters  against  non-TCAS  threats 
(except,  of  course,  the  Mode  C  surveillance  failure).  Also,  the  probability  is  of  the  order 
[l(h^  =  10^  that  the  encounter  would  be  unresolved  due  to  both  TCAS  aircraft 

independently  failing  to  track  each  other. 

The  probability  of  Mode  S  surveillance  failure  is  thus  negligible  relative  to  the  .03 
probability  used  for  Mode  C  surveillance  failure.  Accordingly,  this  event  should  not 
contribute  measurably  to  the  Risk  Ratio. 

4.22  Coordination  Link  Failure 

The  second  of  these  event  chains  has  been  evaluated  by  Lincoln  Laboratory  [II].  Extracting 
the  relevant  portions  of  their  analysis,  we  calculate: 
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P  0tnk  dropout  that  prevents  cocndinadon 
before  advisory  display) 

X  P(link  dropmit  prevents  timely  selection 
of  onnpatible  sense) 

X  P(inadequate  hcnizonta)  separation) 


.000012 

.00000011 

.08 


1  X  10**3 

This  result  states  that  one  in  ten  trillion  TCAS-TCAS  RAs  would  be  expected  to  have  both 
uncoordinated  vertical  sense  and  inadequate  horizontal  separation.  This  is  smaller  by  many 
(xrders  of  magnitude  than  most  other  risks  considered  in  this  study.  It  could  be  redut^  even 
more  by  considering  that  for  only  a  fraction  of  such  encounters  would  both  TCAS  aircraft 
select  the  same  (incompatible)  sense,  even  without  coordination. 

4.23  Failure  to  Follow  TCAS  Advisory 

In  a  TCAS-TCAS  encounter,  the  logic  and  coordination  functions  ensure  selection  and 
display  of  compatible  advisories.  The  FAA  Technical  Center  has  performed  extensive 
simulations  of  such  encounters  [12]  and  have  concluded  that  in  virtually  every  encounter 
geometry,  the  two  aircraft  could  have  avoided  a  NMAC  by  following  their  respective  TC2AS 
advisories.  This  leads  to  the  conclusion  that  s  maneuver  contrary  to  the  direction  advised  by 
TCAS  is  likely  to  reduce  the  vertical  separation.  A  simple  failure  to  respond  (rather  than  a 
maneuver  in  the  direction  opposite  to  the  advisory)  may  have  various  results:  the  other 
TCAS  may  achieve  good  separation  with  its  own  maneuver,  as  in  an  encounter  with  a  non- 
TCAS;  however,  for  some  geometries,  one  aircraft’s  maneuver  would  provide  most  of  the 
resolution,  while  the  other  receives  a  complementary  advisory  primarily  to  preclude  the 
opposite  direction  maneuver  (which  could  negate  the  first  TCAS’  resolution).  In  this  latter 
case,  one  aircraft's  failure  to  respond  would  be  of  greater  significance  than  the  other's. 

This  failure  category  has  potentially  greater  significance  than  any  other  failure  studied  for  the 
TCAS-TCAS  encounters.  Unfortunately,  its  magnitude  is  difficult  to  measure  and  especially 
difficult  to  predict.  There  is  no  evidence  that  the  change  of  logic  version  would  increase  risk 
of  this  type.  To  the  contrary,  if  v6.04  promotes  increased  pilot  confidence  in  TCAS,  as  is 
intended  more  of  its  advisories  may  be  followed,  with  a  resulting  safety  benefit 

4.2.4  Unsafe  Resolution  Advisories 

A  coordinated  TCAS-TCAS  encounter  should  always  produce  a  successful  resolution  if  the 
advisories  are  followed.  The  FAA  Technical  Center  has  conducted  extensive  simulation  of 
encounters  to  search  for  either  routine  or  extreme  conditions  which  could  bring  about  an 
unsuccessful  resolutif)n  f  12].  Both  versions  of  TCAS  logic  were  tested,  as  well  as 
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iiueropenl^^  of  a  V6.0TXIAS  against  a  v6.04TCAS.  The  only  geometiy  that  was 
report  10  fail  innd^  an  atoaft  initially  dimbing  at  a  rale  oi 5000  and  oicountering 

a  l^wlaiiciaft  as  it  bqpui  10  levd  off  with  a  1/3  g  acceleration.  Both  logk  versions  are 
susceptible  to  diis  geometiy,  although  their  thresholds  of  vulnerability  t^Efier. 

In  the  U.S.  database  containing  over  10,000  d)served  encounters,  only  (me  of  the  over  20,000 
aiicraft  had  a  vertical  rate  oi  tfeds  magnitude  during  an  encounter  window.  None  of  the  RA- 
producing  encounters  had  an  aiicraft  with  such  a  hidt  vertical  rate.  While  this  data  seems  to 
exaggerate  the  scarcity  of  fli^it  at  high  rates,  it  is  clear  dtat  close  encounters  of  this  type  are 
extremely  infrequent  in  compaiistm  to  die  routine  encounters  that  contribute  to  the  Ratio 
compcment  for  unequipped  intruders.  The  logic-related  ccmiponent  of  Risk  Ratio  then  should 
be  smaller  by  severd  <mders  of  magnitude  than  the  poformance  of  the  logic  in  encounters 
with  unequipped  threats. 

4.2S  Summary 

The  discussion  in  this  section  shows  that  none  of  dm  TCAS-TCAS  events  shouli  increase  the 
Risk  Ratio  except  the  case  of  the  failure  to  follow  a  TCAS  advisory.  The  factors  are  not 
explicidy  logic-dependent,  although  any  increased  confidence  in  TCAS,  as  is  the  intent  of 
v6.04,  may  bring  about  increased  compliance. 
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SECTIONS 


CONCLUSIONS 


This  study  has  examined  over  10,000  aircraft  encounters  at  eight  sites  having  different 
environnrents  with  respect  to  encounter  geometries.  Encounter  modeling  was  cmiducted 
based  upon  1889  RA-producing  encounters.  780,000  Simulation  runs  using  the  complete 
logic  have  exocised  a  wide  variety  of  gemnetry  types  for  unequipped  threats. 

1.  For  the  comiition  that  all  TCAS  RAs  are  followed  unless  recognized  as  unsafe,  logic 
v6.04  would  produce  a  Risk  Ratio  only  about  me  percent  greater  than  for  v6.0,  on  a 
theoretical  site-average  basis. 

2.  The  greatest  contribution  to  the  v6.04  increment  comes  from  the  altitude  layer  below 
2350  ft,  where  the  lowest  warning  time  is  used.  Since  the  ATC  system  is  highly 
structured  in  that  airspace,  using  the  overall  distributions  of  encounter  classes  and 
vertical  rates  may  be  unrealistic  and  give  pessimistic  results.  Excluding  the  lowest 
layer,  the  Risk  Ratio  increment  is  about  0.6  percent 

3.  The  variation  of  this  Risk  Ratio  increment  among  the  sites  studied  was  not  great 
despite  very  substantial  differences  in  the  encounter  geometry  proportions  that  were 
found.  The  greatest  change  in  Risk  Ratio  for  any  of  these  sites  was  1.7  percent.  This 
gives  confidence  that  studying  other  locations  also  would  yield  results  very  similar  to 
the  average  figure.  Furthermore,  the  increment  due  to  the  new  logic  version  is  of  the 
same  order  as  normal  site-to-site  variations. 

4.  Recogniring  that  today  pilots  frequently  do  not  follow  RAs,  often  because  of  low 
confidence  in  TCAS,  the  achiev^  level  of  safety  may  be  far  from  the  ideal.  If  v6.04 
raises  pilot  confidence  to  the  point  where  even  a  few  percent  more  RAs  are  followed, 
the  achieved  level  of  safety  would  increase,  more  than  compensating  for  the  reduction 
in  warning  time  that  eliminates  many  unnecessary  RAs. 

5.  For  coordinated  TCAS-TCAS  encounters,  the  logic,  surveillance,  and  coordination 
functions  are  extremely  safe.  The  greatest  hazard  in  this  situation  would  be  the 
failure  to  follow  RAs.  This  may  be  alleviated  if  v6.04  brings  about  increased 
compliance. 

6.  The  Risk  Ratio  component  due  to  logic  is  only  slightly  degraded  by  imperfect 
surveillance  quality.  The  relative  performance  of  the  two  logic  versions  appears 
unchanged. 
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7.  WhenTCASisinaclimb-inMbitedfH^titgiine,orisdesceiKl-iiihibitedduetoits 
proximity  with  the  pound,  its  peifmmance  is  significantly  restricted.  Such  situations 
should  occur  very  infrequently  reladw  to  the  rate  of  close  encounters  addressed  in 
this  study. 
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APPENDIX  A 

ALTIMETRY  ERROR  ANALYSIS 


This  a{q)endix  reports  the  results  of  a  study  of  altimeay  error  on  TVaISc  Alert  and  Qdlision 
Avredance  System  n  (TCAS  ID  Safety.  It  is  an  update  of  fee  analysis  peifonned  in  fee  two 
preceding  TCAS  Safe^  Stiuiies.  As  in  these  earlier  studies,  barometric  ahimetry  error  is 
consider^  as  a  potential  cause  of  either 

1.  TCAS  failing  to  resolve  an  Near  Mid-Air  Goliisum  (NMAC)  which  would  have 
occurred  in  its  absence. 

2.  A  maneuver  made  in  response  to  an  TCAS  advisory  leads  to  ("induces")  an  NMAC, 
which  otherwise  would  not  have  occurred. 

These  conditions  can  result  when  the  algebraic  sum  of  altimetry  errors  in  the  pair  of  aircraft 
in  the  encounter  tend  to  distort  the  Mode  C  reports,  and  hence  the  perceived  vertical  state  of 
the  encounter  geometry,  to  fee  extent  feat  TCAS  erroneously  perceives  safe  separation  in  fee 
first  case,  or  erroneously  perceives  fee  situation  and  issues  advisories  that  tend  to  reduce 
separation  in  fee  second  case.  (It  should  be  noted  that  fee  same  erroneous  perception  would 
be  made  by  a  TCAS  onboard  either  aircraft,  as  well  as  by  Air  Traffic  Control  [ATfT].) 

The  1988  Safety  Study  incorporated  a  model  for  altimetry  error  based  on  fee  results  of  Held 
studies  conduct^  at  both  low  and  high  altitudes.  Different  distributions  were  derived  to 
represent  high-quality  corrected  altimetry  typical  of  air  carriers,  and  uncorrected  altimetry  as 
found  on  much  of  General  Aviation  (GA).  The  Air  C^arrier  distribution  derived  in  fee  1983 
Safety  Study  combined  error  budgets  for  Static  Source,  Transducer,  and  (^antization  errors, 
resulting  in  standard  deviations  ranging  from  45  to  95  it  according  to  altitude.  For  GA,  fee 
distribution  is  modeled  as  a  Laplacian  (Double  Exponential)  function  in  order  to 
conservatively  upper-bound  fee  distribution  tails,  wife  standard  deviation  varying  from  67  ft 
at  low  altitude  to  105  ft  at  high  altitude. 

The  Altimetry  analysis  uses  an  analytical  approach  to  determine  fee  contribution  to  Risk 
Ratio.  No  encounters  are  explicitly  model^  wife  fee  logic;  instead,  fee  logic  is  assumed  to 
provide  fee  nominal  separation  for  which  it  is  designed.  Two  components  are  considered: 

(1)  actual  vertical  separation  (projected  ahead  to  closest  point  of  approach  [CPA])  and  (2) 
errors  in  reported  altimetry,  combined  for  fee  two  aircraft.  These  elements  are  considered  to 
form  a  plane  space.  Regions  in  this  space  are  identified  for  which  these  components  combine 
so  as  to  cause  TCAS  either  to  accept  fee  perceived  separation  and  fail  to  resolve  an  NMAC, 
or  to  issue  an  advisory  which  appears  to  increase  the  reported  separation,  but  which  actually 
induces  an  NMAC.  The  calculation  considers  the  perceived  separation  achievable  by  TCAS 
according  to  fee  version  of  logic  and  the  parameters  in  effect  for  each  altitude  layer.  Version 
6.04  logic  has  smaller  TAU  values,  and  correspondingly  smaller  vertical  separations.  Also, 
for  potential  crossing  encounters,  TCAS  selects  fee  non-crossing  sense  when  it  predicts  feat 
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altitude  lonit  (AUM)  ft  squration  ctn  be  achieved.  To  conservatively  ui^-bound  the  risk, 
only  ALIM  ft  sqwration  is  assumed  ftar  ail  die  fraction  of  encoimtms  with  crossing 

geometries. 

The  potinent  logic  variable  in  this  analysis  is  die  pmmneter  AUM,  which  has  been  revised  in 
the  v6.04  logic.  The  calculation  is  performed  over  a  number  of  altitude  layers  to  account  for: 
the  altimetry  error  modeted  as  a  function  (rf  altitude,  for  changing  valims  (rf  AUM,  and  for 
the  histairic^  proportion  oi  NMAC  encmmters  reported  by  altitude.  The  study  combines 
79  percent  of  threats  expected  to  have  uncorrected  altimetry  with  21  percent  expected  u>  have 
corrected  altimetry.  Calculations  ate  repeated  for  threats  with  conected  and  with  uncccrected 
altimetry  models.  Also,  simulations  of  recorded  encounters  show  that  the  vmsion  6.04  logic 
selects  a  crossing  sense  for  only  fmir  percent  The  cooqxmte  results  follow: 


Version  6.0  Versitm  6.04 
Unresolved  NMAC  .006  .019 

Induced  NMAC  .017  .022 

TOTAL  .023  .041 


The  fundamental  concern  motivating  this  study  was  to  evaluate  the  decreased  protection 
against  altimetry  errors  that  might  result  from  the  smaller  values  of  AUM  used  in  v6.04. 
These  results  apply  to  the  conditional  probability  of  a  conflict  with  a  transponder-equipped 
threat  If  the  pilot  were  to  follow  every  Resolution  Advisory  (RA)  without  visual  avoidance 
of  hazardous  conflicts,  the  new  logic  would  increase  the  risk  by  less  than  two  percent  on  an 
absolute  basis. 
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APPENDIX  B 


SIMULATION  PARAMETERS 


This  appendix  contains  data  fen:  stnne  aspects  of  dw  simuladon  nms  described  in  this  study. 
Additional  documentation  for  the  simulation  will  be  found  in  [8]. 

B.l  RATE  DISTRIBUTIONS 

Distribunons  for  vertical  rates  were  derived  from  the  database.  Figures  23  through  27 
display  the  histograms  of  these  distribudons.  any  emxninter  run,  each  aircraft  profile 

used  an  independently  selected  rate  from  the  appropriate  distribunon. 

In  these  figures,  the  x-axis  label  denotes  the  upper  limit  of  the  histogram  bar.  In  figure  23, 
absolute  values  are  plotted,  although  the  rate  may  have  climbing  or  descending  sense.  For 
these  classes,  the  "level"  aircraft  are  usually  nearly-level,  with  low  rates.  The  class 
definidons  limited  this  class  to  400  feet  per  minute  (fpm)  or  less.  The  data  shows  most  of  the 
aircraft  to  have  very  low  average  rates. 


Rate  (fpm) 

Figure  23.  Vertical  Rates  for  "Level"  Aircraft 


Figure  24  shows  the  rtues  implied  to  constant-rate  aircraft  and  to  aircraft  with  rates  bef(»e  any 
leveloff.  Again,  absolute  values  are  plotted  for  these  data.  These  rates  also  tend  towards  the 
lower  end  of  the  scale,  although  rates  up  to  4000  fpin  are  observed. 


Figure  24.  Vertical  Rates  for  Climbing  or  Descending  Aircraft 
Classes  1/11, 3/13, 6/16  (Before  Leveloff) 


Figure  25  displays  the  rates  for  constant-rate  aircraft  in  different  classes.  These  rates  cluster 
around  the  level  rates,  which  by  definition  do  not  fall  within  these  classes.  The  signed  rates 
are  seen  to  be  non-symmetrical. 

Figures  26  and  27  show  rates  for  aircraft  that  maneuver  after  initially  flying  level.  The  data, 
which  also  is  signed,  shows  more  descents  than  climbs,  and  contains  mostly  low  rates. 
However,  a  few  substantial  descent  rates  are  observed. 
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Figure  25.  Vertical  Rates  for  Climbing  or  Descemling  Aircraft 
Classes  4/14, 5/15, 6/15  (Constant  Rate) 
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Figure  26.  Vertical  Rates  after  Level  Segment  Classes  2/12 
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Figure  27.  Vertical  Rates  after  Level  Segment  Classes  5/15 


BJ  ACCELERATION  DISTRraunON 

The  reconstructed  Automated  Radar  Terminal  System  (ARTS)  data  does  not  contain  enough 
fidelity  to  accurately  measure  accelerations;  this  is  chie  to  the  quantization  of  the  original 
altitudie  reports  to  100  ft  and  to  the  quantization  of  time  samples  to  one  second.  These  factors 
make  it  possible  only  to  bound  the  accelerations  observed. 

A  distribution  developed  for  simulation  testing  prior  to  the  database  with  the  help  of 
members  of  the  air  transport  community  was  examined  for  this  study.  This  distribution 
recognized  the  frequent  usage  of  autc^Uots  and  the  consequent  low  values  of  acceleration  for 
many  maneuvers.  The  shape  of  the  average  rate  changes  in  the  encounter  database  also  fit 
the  shape  of  this  distribution.  Consequendy,  it  was  adopted  for  the  simulation.  Figure  28 
shows  this  distribution. 


BJ  LAYER  WEIGHTS 

Table  8  contains  the  weights  used  to  combine  results  from  the  six  altitude  layers.  These 
frequencies  are  taken  from  the  aldtudes  of  reported  NMACs  in  the  Federal  Aviation 
Adnunistration  (FAA)  database  that  was  used  in  the  original  TCAS  Safety  Study.  The  low- 
altitude  NMACs  were  further  divided  by  altitude  u>  develop  the  weights  for  layers  1  and  2. 
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Acceleration  (g) 


Figure  28.  Distribution  of  Verticai  Accderatioos  for  Simulations 


Tables.  Layer  Weights 


Layer 

NMAC  Frequency 

1 

.14 

2 

.27 

3 

.33 

4 

.21 

5 

.04 

6 

.01 
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APPENDIX  C 


SIMULATION  RESULTS  FOR  NMAC 


This  qypoidn  presents  the  data  fiom  die  encounter  simuladcms  of  v6.04  foreveiy  class  and 
layer.  The  statistics  shown  give  the  firacdon  of  simulated  NMACs  that  were  unresolved  by 
TCAS  and  die  fraction  ai  non-NMACs  for  which  an  NMAC  was  induced  by  TCAS.  These 
do  not  include  the  effects  of  altimetry  eiror. 

The  fractirms  shmvn  wme  formed  by  simply  summing  the  runs  fiv  each  vmtical  band.  Post¬ 
processing,  not  included  here,  conbines  results  of  di^  bands  by  weighting  them  in  the 
proportirMi  observed  m  the  airspace;  therefore,  this  data  is  not  a  direct  estimate  of  probability 
of  these  events  in  the  airspace.  However,  it  is  a  good  means  of  comparing  performance 
between  the  altitude  layers. 

The  figures  show  that  the  unresolved  component  is  dominant  for  most  classes  at  most  altitude 
layers. 
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Table  9.  V6.04  Sim  Results 


CLASS  10 


LAYER  UNRESOLVED!  INDUCED 


1|  0.034  0.00011 


2 


3 


CLASS  11 


LAYER 


Class  1 


CLASS  12 


LAYER 


CLASS  13 


LAYER 


UNRESOLVED 


0.102 


0.003 


UNRESOLVED 


0.063 


0.006 


0.002 


INDUCED 


UNRESOLVED 


0.054 


0 


0 


INDUCED 


INDUCED 


0.0074 


0.00267 


0.00156 


0.00144 


0.001 


0.00033 


LAYER 

UNRESOLVED 

INDUCED 

1 

0.098 

0.00067 

0.00022 


0.00033 


0.00033 


0.00022 


0.0001 1 


CLASS  2 


LAYER 

UNRESOLVED 

INDUCED 

1 

0.014 

0.00011 

2 

0 

0 

3 

0 

0 

4 

0.001 

0 

5 

0 

0 

6 

0 

0 

CLASS  3 


LAYER 


UNRESOLVED 


0.047 


0.003 


0.003 


INDUCED 


Tidri«9.  V6.04  Sira  Results  (Conduded) 


CLASS  14 
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1 

a029 

0.00033 

2 

OjOOl 

OJQ0056 

3 

0 

0.00011 

4 

0.001 

0 

5 

0 

0 

6 

0 

ODOOll 

CLASS  IS 

LAYER 

UNRESOLVED 

INDUCED 

1 

0.036 

0 

2 

"oM 

^  0 

3 

0 

0 

4 

0 

0 

5 

0 

0 

6 

0 

0.00011 

CLASS  14 

LAYER 

UNRESOLVED 

INDUCED 

1 

0.082 

0.0044 

2 

0.016 

0.00278 

3 

0.003 

0.00133 

4 

0 

0.00033 

5 

0 

0 

6 

0 

0.00022 

CLASS4 

LAYEE 

UNRESOLVI^ 

DflHJCm 

1 

Oj028 

dilooTg 

2 

Oj004 

bjQOl 

3 

Qjm 

0M022 

■  ■  '  4 

0 

0 

5 

0 

0 

6 

OjQOI 

0 

CLASS  5 

LAYER 

UNRESOLVED 

INDUCED 

1 

ODI# 

^  0 

. 2' 

'  '  '  " 

. 3 

'  o.ooi 

0 

4 

0 

01XX)11 

S 

0 

0 

. 6' 

0 

0 

CLASS# 

LAYER 

UNRESOLVED 

INDUCED 

1 

0.00067 

1 

Di)l4 

0 

3 

OJOOS 

0^)0011 

4 

0 

0.00022 

5 

0 

0 

6 

0 

0 
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Fraction  of  Runs  Producing  NMAC  Fraction  of  Runs  Produdng  NMAC 


Class  1  V  6.04  Logic 


■  UNRESOLVED 
□  INDUCED 


3  4  5  6 

Layer 


Figure  29.  Logic  Performance— Class  1 
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Figure  30.  Logic  Performance — Class! 
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Fraction  of  Runs  Producing  NMAC  Fraction  of  Runs  Producing  NMAC 
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Figure  33.  Logic  Performance — Class  5 


Class  6  V  6.04  Logic 


■  UNRESOLVED 
□  INDUCED 


Layer 


5 


Figure  34.  Logic  Performance — Class  6 
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Producing  NMAC  Fraction  of  Runs  Producing  NMAC 


Classic  V 6.04 Logic 
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Figure  35.  Logic  Performance — Class  10 

Class  11  V  6.04  Logic 
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Class  12  V  6.04  Logic 


Layer 

Figure  37.  Logic  Performance — Class  12 

Class  13  V  6.04  Logic 

0.07  ■’ 
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Figure  38.  Logic  Performance — Class  13 
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Fraction  of  Runs  Producing  NMAC 


S 


Class  14  V6.04 Logic 
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Figure  39.  Logic  Performance — Class  14 
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Figure  40.  Logic  Performance — Class  15 
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Class  16  V  6.04  Logic 


0.09 


Layor 

Figure  41.  Lo^c  Perfoniiance— Class  16 
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APPENDIX  D 


ALTIMETRY  ERROR  EFFECTS  ON  VERTICAL  SEPARATION 


This  sqipeiidix  addresses  the  effect  oi  altimetry  enors  on  tiie  sqiaration  statistics  of  TCAS 
encounters  generated  by  Mtmte  Cario  simulations  and  provides  fonnulas  for  incorporating 
these  enors  in  a  manner  consistent  with  previous  wxk. 

A  recent  update  to  the  TCAS  n  safety  study  [4]  beats  the  net  altimetry  error,  for  any  aircraft, 
as  a  random  variable  witii  a  Lapladan  (Double  Exponential)  distribution  (equaticm  1)  having 
<M)e  parameter,  sigma,  that  is  a  function  of  altitude,  altimeter  maintenance  and,  possibly,  other 
factors.  Empirical  valites  for  sigma  have  been  reptxied  for  seven  altitude  regions. 

f(x)  =  (2o)-»exp(:y)  1. 

The  vertical  overlap  density  for  a  pair  of  aircraft  is  given  by  the  convolution  of  two  such 
Laplacians.  Therefore,  the  probability  that  two  airci^t  with  a  reported  vertical  separation,  S, 
are  actually  within  h  feet  of  each  other  can  be  found  by  integrating  the  convolution  over  the 
vertical  interval  S  ±  h.  [For  instance,  the  vertical  NMAC  region  would  have  h  =  1(X)  feet.] 

The  following  treats  separately  the  cases  in  which  the  two  parameters  are  equal  and  unequal. 

When  the  parameters  are  equal,  the  convolution  is  given  by  equation  2  [9]. 

C(z)  =  (4a2)-^(l2j  +  <y)exp(^)  2. 

The  formulas  for  computing  the  overlap  probability  are  given  below.  Since  the  convolution 
contains  an  absolute  value,  there  are  two  cases  to  consider,  viz.,  (S  •  h)  ^  0  and  (S  -  h)  ^  0 
where  S  and  h  ate  taken  as  positive  quantities. 

For  (S  -  h)  >  0,  the  overlap  probability  is  given  by  equation  3. 

Probdsepl  ^  h)  =  (4  a)-‘  exp('^-^-  -^  [exp(^)  (2  a  +  S  -  h)  -  (2  o  +  S  +  h)]  3. 

For  (S  •  h)  ^  0,  the  overlap  probability  is  given  by  equation  4. 

Probdsepl  S  h)  =  1  -  (4  a)'*  exp('^^q-  *^6  [exp(^)  (2  a  -  S  +  h)  +  (2  a  +  S  +  h)]  4. 

When  the  parameters  are  unequal,  the  convolution  is  given  by  equation  5. 
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C(2) 


5. 


2(of-<^) 


Once  again,  there  are  two  cases: 


For  (S  -  h)  2  0,  the  overlap  probability  is  given  by  equation  6. 


Prob(^p|^h) 


of  exp(^)  sinh(^)  -  dj  exp(^)  smh(^) 
of-of 


6. 


For  (S  -  h)  ^  0,  the  overlap  probability  is  given  by  equation  7. 


ProbOsepI  ^  h)  = 


of  [1  -  exp(^)  cosh(^)]  -  of  [1  -  exp(^)  cosh(^)] 

of-of 


7. 


Note  that,  when  S  =  h,  equations  3  and  4  become  equivalent  as  do  equations  6  and  7. 

These  equations  were  further  checked  by  comparison  with  the  results  of  Monte  Carlo 
simulations.  Five  million  iterations  were  carri*^  out  for  each  of  the  four  cases  (eqs.  3, 4, 6 
and  7).  Variance  reduction  was  achieved  through  the  use  of  antithetic  variates  [A-1].  The 
results  are  presented  in  table  10. 


Table  10.  Simulation  versus  Analytical  Results 


Equation 

S 

h 

Oi 

02 

Prob(|sep|  <  h) 
Simulation  Equation 

3 

1000 

100 

144 

144 

0.002823 

0002822 

4 

200 

300 

165 

165 

0.583963 

0.583859 

6 

500 

100 

100 

150 

0.039614 

0.039716 

7 

200 

500 

100.0 

100.1 

0.935710 

0.935633 
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GLOSSARY 


AGL 

ARTS 

ATC 

Above  Ground  Level 

Automated  Radar  Tenninal  System 

Air  Traffic  Contrtd 

CPA 

Closest  Point  of  Approach 

FAA 

FPM 

Federal  Aviation  Administration 

Feet  Per  Minute 

GA 

General  Aviadon 

HMD 

Horizontal  Miss  Distance 

IFR 

Instrument  Flight  Rules 

NMAC 

NMI 

Near  Midair  Collision 

Nautical  Mile 

RA 

Resolution  Advisory 

TA 

TCAS 

Traffic  Advisory 

Traffic  Alert  and  Collision  Avoidance  System  II 

VFR 

VMD 

Visual  Flight  Rules 

Vertical  Miss  Distance 
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